Nov 15 05:34:41 user nova-compute[75648]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75648) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75648) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75648) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 15 05:34:41 user nova-compute[75648]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:34:41 user nova-compute[75648]: INFO nova.virt.driver [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 15 05:34:41 user nova-compute[75648]: INFO nova.compute.provider_config [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Acquiring lock "singleton_lock" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Acquired lock "singleton_lock" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Releasing lock "singleton_lock" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Full set of CONF: {{(pid=75648) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ******************************************************************************** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Configuration options gathered from: {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ================================================================================ {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] allow_resize_to_same_host      = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] arq_binding_timeout            = 300 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] backdoor_port                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] backdoor_socket                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] block_device_allocate_retries  = 300 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] block_device_allocate_retries_interval = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cert                           = self.pem {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute_monitors               = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] config_dir                     = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] config_drive_format            = iso9660 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] config_source                  = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] console_host                   = user {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] control_exchange               = nova {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cpu_allocation_ratio           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] daemon                         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] debug                          = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] default_access_ip_network_name = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] default_availability_zone      = nova {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] default_ephemeral_format       = ext4 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] default_green_pool_size        = 1000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] default_schedule_zone          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] disk_allocation_ratio          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] enable_new_services            = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] enabled_apis                   = ['osapi_compute'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] enabled_ssl_apis               = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] flat_injected                  = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] force_config_drive             = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] force_raw_images               = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] graceful_shutdown_timeout      = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] heal_instance_info_cache_interval = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] host                           = user {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_build_timeout         = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_delete_interval       = 300 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_format                = [instance: %(uuid)s]  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_name_template         = instance-%08x {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_usage_audit           = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_usage_audit_period    = month {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] internal_service_availability_zone = internal {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] key                            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] live_migration_retry_count     = 30 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_config_append              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_dir                        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_file                       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_options                    = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_rotate_interval            = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_rotate_interval_type       = days {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] log_rotation_type              = none {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] long_rpc_timeout               = 1800 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] max_concurrent_builds          = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] max_concurrent_live_migrations = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] max_concurrent_snapshots       = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] max_local_block_devices        = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] max_logfile_count              = 30 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] max_logfile_size_mb            = 200 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] maximum_instance_delete_attempts = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metadata_listen                = 0.0.0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metadata_listen_port           = 8775 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metadata_workers               = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] migrate_max_retries            = -1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] mkisofs_cmd                    = genisoimage {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] my_ip                          = 10.0.0.210 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] network_allocate_retries       = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] osapi_compute_listen_port      = 8774 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] osapi_compute_unique_server_name_scope =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] osapi_compute_workers          = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] password_length                = 12 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] periodic_enable                = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] periodic_fuzzy_delay           = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] pointer_model                  = ps2mouse {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] preallocate_images             = none {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] publish_errors                 = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] pybasedir                      = /opt/stack/nova {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ram_allocation_ratio           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rate_limit_burst               = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rate_limit_except_level        = CRITICAL {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rate_limit_interval            = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reboot_timeout                 = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reclaim_instance_interval      = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] record                         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reimage_timeout_per_gb         = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] report_interval                = 120 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rescue_timeout                 = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reserved_host_cpus             = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reserved_host_disk_mb          = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reserved_host_memory_mb        = 512 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] reserved_huge_pages            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] resize_confirm_window          = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] resize_fs_using_block_device   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] resume_guests_state_on_host_boot = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rpc_response_timeout           = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] run_external_periodic_tasks    = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] running_deleted_instance_action = reap {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] running_deleted_instance_poll_interval = 1800 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] running_deleted_instance_timeout = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler_instance_sync_interval = 120 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_down_time              = 720 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] servicegroup_driver            = db {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] shelved_offload_time           = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] shelved_poll_interval          = 3600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] shutdown_timeout               = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] source_is_ipv6                 = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ssl_only                       = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] state_path                     = /opt/stack/data/nova {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] sync_power_state_interval      = 600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] sync_power_state_pool_size     = 1000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] syslog_log_facility            = LOG_USER {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] tempdir                        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] timeout_nbd                    = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] transport_url                  = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] update_resources_interval      = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_cow_images                 = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_eventlog                   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_journal                    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_json                       = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_rootwrap_daemon            = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_stderr                     = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] use_syslog                     = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vcpu_pin_set                   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plugging_is_fatal          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plugging_timeout           = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] virt_mkfs                      = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] volume_usage_poll_interval     = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] watch_log_file                 = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] web                            = /usr/share/spice-html5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_concurrency.disable_process_locking = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.auth_strategy              = keystone {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.compute_link_prefix        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.dhcp_domain                = novalocal {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.enable_instance_password   = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.glance_link_prefix         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.instance_list_per_project_cells = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.list_records_by_skipping_down_cells = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.local_metadata_per_cell    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.max_limit                  = 1000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.metadata_cache_expiration  = 15 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.neutron_default_tenant_id  = default {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.use_forwarded_for          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.use_neutron_default_nets   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_dynamic_targets = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_jsonfile_path   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.backend                  = dogpile.cache.memcached {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.backend_argument         = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.config_prefix            = cache.oslo {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.dead_timeout             = 60.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.debug_cache_backend      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.enable_retry_client      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.enable_socket_keepalive  = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.enabled                  = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.expiration_time          = 600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.hashclient_retry_attempts = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_dead_retry      = 300 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_password        =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_pool_maxsize    = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_sasl_enabled    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.memcache_username        =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.proxies                  = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.retry_attempts           = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.retry_delay              = 0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.socket_keepalive_count   = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.socket_keepalive_idle    = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.socket_keepalive_interval = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.tls_allowed_ciphers      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.tls_cafile               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.tls_certfile             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.tls_enabled              = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cache.tls_keyfile              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.auth_section            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.auth_type               = password {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.cafile                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.certfile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.collect_timing          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.cross_az_attach         = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.debug                   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.endpoint_template       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.http_retries            = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.insecure                = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.keyfile                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.os_region_name          = RegionOne {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.split_loggers           = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cinder.timeout                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.cpu_dedicated_set      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.cpu_shared_set         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.image_type_exclude_list = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.max_concurrent_disk_ops = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.max_disk_devices_to_attach = -1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.resource_provider_association_refresh = 300 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.shutdown_retry_interval = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] conductor.workers              = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] console.allowed_origins        = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] console.ssl_ciphers            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] console.ssl_minimum_version    = default {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] consoleauth.token_ttl          = 600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.cafile                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.certfile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.collect_timing          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.connect_retries         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.connect_retry_delay     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.endpoint_override       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.insecure                = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.keyfile                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.max_version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.min_version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.region_name             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.service_name            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.service_type            = accelerator {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.split_loggers           = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.status_code_retries     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.timeout                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] cyborg.version                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.backend               = sqlalchemy {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.connection            = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.connection_debug      = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.connection_parameters =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.connection_recycle_time = 3600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.connection_trace      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.db_inc_retry_interval = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.db_max_retries        = 20 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.db_max_retry_interval = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.db_retry_interval     = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.max_overflow          = 50 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.max_pool_size         = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.max_retries           = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.mysql_wsrep_sync_wait = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.pool_timeout          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.retry_interval        = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.slave_connection      = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] database.sqlite_synchronous    = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.backend           = sqlalchemy {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.connection        = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.connection_debug  = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.connection_parameters =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.connection_recycle_time = 3600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.connection_trace  = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.db_inc_retry_interval = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.db_max_retries    = 20 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.db_max_retry_interval = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.db_retry_interval = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.max_overflow      = 50 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.max_pool_size     = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.max_retries       = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.pool_timeout      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.retry_interval    = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.slave_connection  = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] api_database.sqlite_synchronous = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] devices.enabled_mdev_types     = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ephemeral_storage_encryption.enabled = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.api_servers             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.cafile                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.certfile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.collect_timing          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.connect_retries         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.connect_retry_delay     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.debug                   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.default_trusted_certificate_ids = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.enable_certificate_validation = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.enable_rbd_download     = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.endpoint_override       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.insecure                = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.keyfile                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.max_version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.min_version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.num_retries             = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.rbd_ceph_conf           =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.rbd_connect_timeout     = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.rbd_pool                =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.rbd_user                =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.region_name             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.service_name            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.service_type            = image {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.split_loggers           = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.status_code_retries     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.timeout                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.verify_glance_signatures = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] glance.version                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] guestfs.debug                  = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.config_drive_cdrom      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.config_drive_inject_password = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.enable_instance_metrics_collection = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.enable_remotefx         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.instances_path_share    =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.iscsi_initiator_list    = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.limit_cpu_features      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.power_state_check_timeframe = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.use_multipath_io        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.volume_attach_retry_count = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.vswitch_name            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] mks.enabled                    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] image_cache.manager_interval   = 2400 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] image_cache.precache_concurrency = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] image_cache.remove_unused_base_images = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] image_cache.subdirectory_name  = _base {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.api_max_retries         = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.api_retry_interval      = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.auth_section            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.auth_type               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.cafile                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.certfile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.collect_timing          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.conductor_group         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.connect_retries         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.connect_retry_delay     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.endpoint_override       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.insecure                = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.keyfile                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.max_version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.min_version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.peer_list               = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.region_name             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.serial_console_state_timeout = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.service_name            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.service_type            = baremetal {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.split_loggers           = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.status_code_retries     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.timeout                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ironic.version                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] key_manager.fixed_key          = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.barbican_api_version  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.barbican_endpoint     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.barbican_endpoint_type = public {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.barbican_region_name  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.cafile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.certfile              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.collect_timing        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.insecure              = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.keyfile               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.number_of_retries     = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.retry_delay           = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.send_service_user_token = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.split_loggers         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.timeout               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.verify_ssl            = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican.verify_ssl_path       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.auth_section = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.auth_type = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.cafile   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.certfile = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.collect_timing = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.insecure = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.keyfile  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.split_loggers = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] barbican_service_user.timeout  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.approle_role_id          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.approle_secret_id        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.cafile                   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.certfile                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.collect_timing           = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.insecure                 = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.keyfile                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.kv_mountpoint            = secret {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.kv_path                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.kv_version               = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.namespace                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.root_token_id            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.split_loggers            = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.ssl_ca_crt_file          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.timeout                  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.use_ssl                  = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.auth_section          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.auth_type             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.cafile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.certfile              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.collect_timing        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.connect_retries       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.connect_retry_delay   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.endpoint_override     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.insecure              = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.keyfile               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.max_version           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.min_version           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.region_name           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.service_name          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.service_type          = identity {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.split_loggers         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.status_code_retries   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.timeout               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] keystone.version               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.connection_uri         =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_mode               = custom {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: WARNING oslo_config.cfg [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_power_governor_high = performance {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_power_governor_low = powersave {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_power_management   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.device_detach_attempts = 8 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.device_detach_timeout  = 20 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.disk_cachemodes        = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.disk_prefix            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.enabled_perf_events    = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.file_backed_memory     = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.gid_maps               = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.hw_disk_discard        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.hw_machine_type        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_rbd_glance_store_name =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_rbd_pool        = rbd {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_type            = default {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.images_volume_group    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.inject_key             = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.inject_partition       = -2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.inject_password        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.iscsi_iface            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.iser_use_multipath     = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_bandwidth = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_downtime = 500 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_inbound_addr = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_permit_post_copy = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_scheme  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_timeout_action = abort {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_tunnelled = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: WARNING oslo_config.cfg [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 15 05:34:41 user nova-compute[75648]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 15 05:34:41 user nova-compute[75648]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 15 05:34:41 user nova-compute[75648]: and ``live_migration_inbound_addr`` respectively.
Nov 15 05:34:41 user nova-compute[75648]: ).  Its value may be silently ignored in the future.
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.live_migration_with_native_tls = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.max_queues             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.nfs_mount_options      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.num_memory_encrypted_guests = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.num_pcie_ports         = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.pmem_namespaces        = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.quobyte_client_cfg     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rbd_secret_uuid        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rbd_user               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.remote_filesystem_transport = ssh {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rescue_image_id        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rescue_kernel_id       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rescue_ramdisk_id      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.rx_queue_size          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.smbfs_mount_options    =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.snapshot_compression   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.snapshot_image_format  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.sparse_logical_volumes = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.swtpm_enabled          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.swtpm_group            = tss {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.swtpm_user             = tss {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.sysinfo_serial         = unique {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.tb_cache_size          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.tx_queue_size          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.uid_maps               = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.use_virtio_for_bridges = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.virt_type              = kvm {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.volume_clear           = zero {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.volume_clear_size      = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.volume_use_multipath   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_cache_path   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.vzstorage_mount_user   = stack {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.auth_section           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.auth_type              = password {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.cafile                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.certfile               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.collect_timing         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.connect_retries        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.connect_retry_delay    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.default_floating_pool  = public {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.endpoint_override      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.extension_sync_interval = 600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.http_retries           = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.insecure               = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.keyfile                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.max_version            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.min_version            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.ovs_bridge             = br-int {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.physnets               = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.region_name            = RegionOne {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.service_metadata_proxy = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.service_name           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.service_type           = network {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.split_loggers          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.status_code_retries    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.timeout                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] neutron.version                = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] notifications.bdms_in_notifications = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] notifications.default_level    = INFO {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] notifications.notification_format = unversioned {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] notifications.notify_on_state_change = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] pci.alias                      = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] pci.device_spec                = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] pci.report_in_placement        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.auth_section         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.auth_type            = password {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.cafile               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.certfile             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.collect_timing       = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.connect_retries      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.connect_retry_delay  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.default_domain_id    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.default_domain_name  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.domain_id            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.domain_name          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.endpoint_override    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.insecure             = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.keyfile              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.max_version          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.min_version          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.password             = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.project_domain_id    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.project_domain_name  = Default {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.project_id           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.project_name         = service {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.region_name          = RegionOne {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.service_name         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.service_type         = placement {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.split_loggers        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.status_code_retries  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.system_scope         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.timeout              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.trust_id             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.user_domain_id       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.user_domain_name     = Default {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.user_id              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.username             = placement {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] placement.version              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.cores                    = 20 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.count_usage_from_placement = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.injected_file_content_bytes = 10240 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.injected_file_path_length = 255 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.injected_files           = 5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.instances                = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.key_pairs                = 100 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.metadata_items           = 128 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.ram                      = 51200 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.recheck_quota            = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.server_group_members     = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] quota.server_groups            = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rdp.enabled                    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.image_metadata_prefilter = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.max_attempts         = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.max_placement_results = 1000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.query_placement_for_image_type_support = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] scheduler.workers              = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.host_subset_size = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.isolated_hosts = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.isolated_images = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.pci_in_placement = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.track_instance_changes = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metrics.required               = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metrics.weight_multiplier      = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] metrics.weight_setting         = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] serial_console.enabled         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] serial_console.port_range      = 10000:20000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] serial_console.serialproxy_port = 6083 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.auth_section      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.auth_type         = password {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.cafile            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.certfile          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.collect_timing    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:41 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.insecure          = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.keyfile           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.send_service_user_token = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.split_loggers     = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] service_user.timeout           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.agent_enabled            = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.enabled                  = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.html5proxy_port          = 6082 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.image_compression        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.jpeg_compression         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.playback_compression     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.server_listen            = 127.0.0.1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.streaming_mode           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] spice.zlib_compression         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] upgrade_levels.baseapi         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] upgrade_levels.cert            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] upgrade_levels.compute         = auto {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] upgrade_levels.conductor       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] upgrade_levels.scheduler       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.auth_section = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.auth_type = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.cafile = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.certfile = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.insecure = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.keyfile = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vendordata_dynamic_auth.timeout = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.api_retry_count         = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.ca_file                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.cache_prefix            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.cluster_name            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.connection_pool_size    = 10 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.console_delay_seconds   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.datastore_regex         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.host_ip                 = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.host_password           = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.host_port               = 443 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.host_username           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.insecure                = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.integration_bridge      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.maximum_objects         = 100 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.pbm_default_policy      = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.pbm_enabled             = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.pbm_wsdl_location       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.serial_port_proxy_uri   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.serial_port_service_uri = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.task_poll_interval      = 0.5 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.use_linked_clone        = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.vnc_keymap              = en-us {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.vnc_port                = 5900 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vmware.vnc_port_total          = 10000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.auth_schemes               = ['none'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.enabled                    = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.novncproxy_port            = 6080 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.server_listen              = 0.0.0.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.vencrypt_ca_certs          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.vencrypt_client_cert       = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vnc.vencrypt_client_key        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.disable_rootwrap   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.enable_numa_live_migration = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.libvirt_disable_apic = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.client_socket_timeout     = 900 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.default_pool_size         = 1000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.keep_alive                = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.max_header_line           = 16384 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.ssl_ca_file               = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.ssl_cert_file             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.ssl_key_file              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.tcp_keepidle              = 600 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] zvm.ca_file                    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] zvm.cloud_connector_url        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] zvm.reachable_timeout          = 300 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.enforce_new_defaults = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.enforce_scope      = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.policy_default_rule = default {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.policy_file        = policy.yaml {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.connection_string     = messaging:// {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.enabled               = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.es_doc_type           = notification {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.es_scroll_size        = 10000 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.es_scroll_time        = 2m {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.filter_error_trace    = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.hmac_keys             = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.sentinel_service_name = mymaster {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.socket_timeout        = 0.1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.trace_requests        = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler.trace_sqlalchemy      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler_jaeger.process_tags   = {} {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler_jaeger.service_name_prefix = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] profiler_otlp.service_name_prefix = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] remote_debug.host              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] remote_debug.port              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.ssl      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_notifications.retry = -1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_messaging_notifications.transport_url = **** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.auth_section        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.auth_type           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.cafile              = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.certfile            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.collect_timing      = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.connect_retries     = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.connect_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.endpoint_id         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.endpoint_override   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.insecure            = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.keyfile             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.max_version         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.min_version         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.region_name         = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.service_name        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.service_type        = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.split_loggers       = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.status_code_retries = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.status_code_retry_delay = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.timeout             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.valid_interfaces    = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_limit.version             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_reports.file_event_handler = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] oslo_reports.log_dir           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_ovs_privileged.group  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] vif_plug_ovs_privileged.user   = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.flat_interface = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.isolate_vif         = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_vif_ovs.per_port_bridge     = False {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] os_brick.lock_path             = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] privsep_osbrick.capabilities   = [21] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] privsep_osbrick.group          = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] privsep_osbrick.helper_command = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] privsep_osbrick.user           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] nova_sys_admin.group           = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] nova_sys_admin.helper_command  = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] nova_sys_admin.user            = None {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG oslo_service.service [None req-fc73c191-cfa1-47ad-8ccf-65a42cde069a None None] ******************************************************************************** {{(pid=75648) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 15 05:34:42 user nova-compute[75648]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Connecting to libvirt: qemu:///system {{(pid=75648) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fe9f157ef50> {{(pid=75648) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 15 05:34:42 user nova-compute[75648]: libvirt:  error : internal error: could not initialize domain event timer
Nov 15 05:34:42 user nova-compute[75648]: WARNING nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fe9f157ef50> {{(pid=75648) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Starting native event thread {{(pid=75648) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Starting green dispatch thread {{(pid=75648) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Starting connection event dispatch thread {{(pid=75648) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 15 05:34:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Connection event '1' reason 'None'
Nov 15 05:34:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 05:34:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.mount [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Initialising _HostMountState generation 0 {{(pid=75648) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 15 05:34:49 user nova-compute[75648]: INFO nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host capabilities <capabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <host>
Nov 15 05:34:49 user nova-compute[75648]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 15 05:34:49 user nova-compute[75648]:     <cpu>
Nov 15 05:34:49 user nova-compute[75648]:       <arch>x86_64</arch>
Nov 15 05:34:49 user nova-compute[75648]:       <model>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <microcode version='1070'/>
Nov 15 05:34:49 user nova-compute[75648]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='osxsave'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='invtsc'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='rsba'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature name='skip-l1dfl-vmentry'/>
Nov 15 05:34:49 user nova-compute[75648]:       <pages unit='KiB' size='4'/>
Nov 15 05:34:49 user nova-compute[75648]:       <pages unit='KiB' size='2048'/>
Nov 15 05:34:49 user nova-compute[75648]:     </cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <power_management>
Nov 15 05:34:49 user nova-compute[75648]:       <suspend_mem/>
Nov 15 05:34:49 user nova-compute[75648]:       <suspend_disk/>
Nov 15 05:34:49 user nova-compute[75648]:       <suspend_hybrid/>
Nov 15 05:34:49 user nova-compute[75648]:     </power_management>
Nov 15 05:34:49 user nova-compute[75648]:     <iommu support='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <migration_features>
Nov 15 05:34:49 user nova-compute[75648]:       <live/>
Nov 15 05:34:49 user nova-compute[75648]:       <uri_transports>
Nov 15 05:34:49 user nova-compute[75648]:         <uri_transport>tcp</uri_transport>
Nov 15 05:34:49 user nova-compute[75648]:         <uri_transport>rdma</uri_transport>
Nov 15 05:34:49 user nova-compute[75648]:       </uri_transports>
Nov 15 05:34:49 user nova-compute[75648]:     </migration_features>
Nov 15 05:34:49 user nova-compute[75648]:     <topology>
Nov 15 05:34:49 user nova-compute[75648]:       <cells num='2'>
Nov 15 05:34:49 user nova-compute[75648]:         <cell id='0'>
Nov 15 05:34:49 user nova-compute[75648]:           <memory unit='KiB'>8189224</memory>
Nov 15 05:34:49 user nova-compute[75648]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 15 05:34:49 user nova-compute[75648]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 05:34:49 user nova-compute[75648]:           <distances>
Nov 15 05:34:49 user nova-compute[75648]:             <sibling id='0' value='10'/>
Nov 15 05:34:49 user nova-compute[75648]:             <sibling id='1' value='20'/>
Nov 15 05:34:49 user nova-compute[75648]:           </distances>
Nov 15 05:34:49 user nova-compute[75648]:           <cpus num='6'>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 15 05:34:49 user nova-compute[75648]:           </cpus>
Nov 15 05:34:49 user nova-compute[75648]:         </cell>
Nov 15 05:34:49 user nova-compute[75648]:         <cell id='1'>
Nov 15 05:34:49 user nova-compute[75648]:           <memory unit='KiB'>8206460</memory>
Nov 15 05:34:49 user nova-compute[75648]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 15 05:34:49 user nova-compute[75648]:           <pages unit='KiB' size='2048'>0</pages>
Nov 15 05:34:49 user nova-compute[75648]:           <distances>
Nov 15 05:34:49 user nova-compute[75648]:             <sibling id='0' value='20'/>
Nov 15 05:34:49 user nova-compute[75648]:             <sibling id='1' value='10'/>
Nov 15 05:34:49 user nova-compute[75648]:           </distances>
Nov 15 05:34:49 user nova-compute[75648]:           <cpus num='6'>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 15 05:34:49 user nova-compute[75648]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 15 05:34:49 user nova-compute[75648]:           </cpus>
Nov 15 05:34:49 user nova-compute[75648]:         </cell>
Nov 15 05:34:49 user nova-compute[75648]:       </cells>
Nov 15 05:34:49 user nova-compute[75648]:     </topology>
Nov 15 05:34:49 user nova-compute[75648]:     <cache>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 15 05:34:49 user nova-compute[75648]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 15 05:34:49 user nova-compute[75648]:     </cache>
Nov 15 05:34:49 user nova-compute[75648]:     <secmodel>
Nov 15 05:34:49 user nova-compute[75648]:       <model>apparmor</model>
Nov 15 05:34:49 user nova-compute[75648]:       <doi>0</doi>
Nov 15 05:34:49 user nova-compute[75648]:     </secmodel>
Nov 15 05:34:49 user nova-compute[75648]:     <secmodel>
Nov 15 05:34:49 user nova-compute[75648]:       <model>dac</model>
Nov 15 05:34:49 user nova-compute[75648]:       <doi>0</doi>
Nov 15 05:34:49 user nova-compute[75648]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 15 05:34:49 user nova-compute[75648]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 15 05:34:49 user nova-compute[75648]:     </secmodel>
Nov 15 05:34:49 user nova-compute[75648]:   </host>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='alpha'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>clipper</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='armv6l'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>spitz</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>nuri</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>kzm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sx1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>z2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>tosa</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>n810</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>n800</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>terrier</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>midway</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>microbit</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>verdex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>highbank</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>akita</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>connex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>collie</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='armv7l'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>spitz</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>nuri</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>kzm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sx1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>z2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>tosa</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>n810</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>n800</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>terrier</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>midway</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>microbit</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>verdex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>highbank</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>akita</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>connex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>collie</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='aarch64'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>integratorcp</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>borzoi</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>spitz</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>nuri</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>musca-b1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>versatileab</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>kzm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>musca-a</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>smdkc210</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sx1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>z2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>tosa</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>sabrelite</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>realview-eb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>n810</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>n800</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>versatilepb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>terrier</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mainstone</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>midway</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>musicpal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>microbit</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>cubieboard</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>verdex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>netduino2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>raspi3b</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>raspi2b</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>cheetah</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>highbank</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>akita</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>connex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>collie</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>raspi0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <acpi default='on' toggle='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='cris'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='i686'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>isapc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>microvm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='kvm'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <pae/>
Nov 15 05:34:49 user nova-compute[75648]:       <nonpae/>
Nov 15 05:34:49 user nova-compute[75648]:       <acpi default='on' toggle='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:       <apic default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='m68k'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>an5206</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>q800</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>next-cube</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='microblaze'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='microblazeel'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='mips'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='16'>malta</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='mipsel'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='16'>malta</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='mips64'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='16'>malta</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>pica61</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>magnum</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='mips64el'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='16'>malta</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mipssim</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>pica61</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>magnum</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='16'>boston</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='ppc'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mac99</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>40p</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>taihu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='ppc64'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>taihu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>40p</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mac99</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='ppc64le'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2048'>powernv9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>taihu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2048'>powernv10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ppce500</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>40p</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>pegasos2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>bamboo</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>g3beige</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>mac99</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sam460ex</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>ref405ep</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2048'>powernv8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='riscv32'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='8'>spike</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>opentitan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='8'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='riscv64'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='8'>spike</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='5'>sifive_u</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>shakti_c</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sifive_e</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='8'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='s390x'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='sh4'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>shix</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>r2d</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='sh4eb'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>shix</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>r2d</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='sparc'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>SS-5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>SS-20</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>LX</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>SS-4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>SS-10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>Voyager</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='sparc64'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sun4u</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>niagara</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>sun4v</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='x86_64'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>64</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>x-remote</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='1'>isapc</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>microvm</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='kvm'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <acpi default='on' toggle='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:       <apic default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='xtensa'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>sim</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>kc705</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ml605</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx200</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx60</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]:   <guest>
Nov 15 05:34:49 user nova-compute[75648]:     <os_type>hvm</os_type>
Nov 15 05:34:49 user nova-compute[75648]:     <arch name='xtensaeb'>
Nov 15 05:34:49 user nova-compute[75648]:       <wordsize>32</wordsize>
Nov 15 05:34:49 user nova-compute[75648]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='4'>sim</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>kc705</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ml605</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>virt</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx200</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>lx60</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 15 05:34:49 user nova-compute[75648]:       <domain type='qemu'/>
Nov 15 05:34:49 user nova-compute[75648]:     </arch>
Nov 15 05:34:49 user nova-compute[75648]:     <features>
Nov 15 05:34:49 user nova-compute[75648]:       <cpuselection/>
Nov 15 05:34:49 user nova-compute[75648]:       <deviceboot/>
Nov 15 05:34:49 user nova-compute[75648]:       <disksnapshot default='on' toggle='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     </features>
Nov 15 05:34:49 user nova-compute[75648]:   </guest>
Nov 15 05:34:49 user nova-compute[75648]: </capabilities>
Nov 15 05:34:49 user nova-compute[75648]: 
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-i440fx-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>i686</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='255'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'/>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='lm'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ide</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-i440fx-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>i686</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='255'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'/>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='lm'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ide</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-q35-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>i686</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='288'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'/>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='lm'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-i386</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-q35-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>i686</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='288'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'/>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='lm'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-i440fx-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>x86_64</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='255'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>efi</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='invtsc'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='rsba'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ide</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-i440fx-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>x86_64</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='255'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>efi</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='invtsc'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='rsba'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ide</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-q35-jammy</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>x86_64</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='288'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>efi</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='invtsc'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='rsba'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 15 05:34:49 user nova-compute[75648]: <domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 15 05:34:49 user nova-compute[75648]:   <domain>kvm</domain>
Nov 15 05:34:49 user nova-compute[75648]:   <machine>pc-q35-6.2</machine>
Nov 15 05:34:49 user nova-compute[75648]:   <arch>x86_64</arch>
Nov 15 05:34:49 user nova-compute[75648]:   <vcpu max='288'/>
Nov 15 05:34:49 user nova-compute[75648]:   <iothreads supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:   <os supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='firmware'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>efi</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:     <loader supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>rom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pflash</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='readonly'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='secure'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>yes</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>no</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </loader>
Nov 15 05:34:49 user nova-compute[75648]:   </os>
Nov 15 05:34:49 user nova-compute[75648]:   <cpu>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-passthrough' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='hostPassthroughMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='maximum' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='maximumMigratable'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>on</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>off</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='host-model' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <vendor>Intel</vendor>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ss'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='vmx'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pcid'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='hypervisor'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arat'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='tsc_adjust'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='umip'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='md-clear'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='arch-capabilities'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='invtsc'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibpb'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='ibrs'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-stibp'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='amd-ssbd'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='rsba'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='require' name='pschange-mc-no'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='erms'/>
Nov 15 05:34:49 user nova-compute[75648]:       <feature policy='disable' name='xsaveopt'/>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:     <mode name='custom' supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>qemu64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>qemu32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>phenom</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>pentium</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>n270</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm64</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>kvm32</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>coreduo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>core2duo</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>athlon</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Westmere</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Snowridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Skylake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>SandyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Penryn</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G5</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G4</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G3</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Opteron_G2</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Opteron_G1</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>IvyBridge</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Icelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Haswell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Rome</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-Milan</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC-IBPB</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>EPYC</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Dhyana</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cooperlake</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>Conroe</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Cascadelake-Server</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-noTSX</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell-IBRS</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='no'>Broadwell</model>
Nov 15 05:34:49 user nova-compute[75648]:       <model usable='yes'>486</model>
Nov 15 05:34:49 user nova-compute[75648]:     </mode>
Nov 15 05:34:49 user nova-compute[75648]:   </cpu>
Nov 15 05:34:49 user nova-compute[75648]:   <memoryBacking supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:     <enum name='sourceType'>
Nov 15 05:34:49 user nova-compute[75648]:       <value>file</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>anonymous</value>
Nov 15 05:34:49 user nova-compute[75648]:       <value>memfd</value>
Nov 15 05:34:49 user nova-compute[75648]:     </enum>
Nov 15 05:34:49 user nova-compute[75648]:   </memoryBacking>
Nov 15 05:34:49 user nova-compute[75648]:   <devices>
Nov 15 05:34:49 user nova-compute[75648]:     <disk supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='diskDevice'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>disk</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cdrom</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>floppy</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>lun</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='bus'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>fdc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sata</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </disk>
Nov 15 05:34:49 user nova-compute[75648]:     <graphics supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='type'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>sdl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vnc</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>spice</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egl-headless</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </graphics>
Nov 15 05:34:49 user nova-compute[75648]:     <video supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='modelType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>cirrus</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>vmvga</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>qxl</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>none</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>bochs</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>ramfb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </video>
Nov 15 05:34:49 user nova-compute[75648]:     <hostdev supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='mode'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>subsystem</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='startupPolicy'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>default</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>mandatory</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>requisite</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>optional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='subsysType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>usb</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>pci</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>scsi</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='capsType'/>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='pciBackend'/>
Nov 15 05:34:49 user nova-compute[75648]:     </hostdev>
Nov 15 05:34:49 user nova-compute[75648]:     <rng supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtio-non-transitional</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>random</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>egd</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>builtin</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </rng>
Nov 15 05:34:49 user nova-compute[75648]:     <filesystem supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='driverType'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>path</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>handle</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>virtiofs</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </filesystem>
Nov 15 05:34:49 user nova-compute[75648]:     <tpm supported='yes'>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='model'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-tis</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>tpm-crb</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:       <enum name='backendModel'>
Nov 15 05:34:49 user nova-compute[75648]:         <value>passthrough</value>
Nov 15 05:34:49 user nova-compute[75648]:         <value>emulator</value>
Nov 15 05:34:49 user nova-compute[75648]:       </enum>
Nov 15 05:34:49 user nova-compute[75648]:     </tpm>
Nov 15 05:34:49 user nova-compute[75648]:   </devices>
Nov 15 05:34:49 user nova-compute[75648]:   <features>
Nov 15 05:34:49 user nova-compute[75648]:     <gic supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:     <vmcoreinfo supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <genid supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backingStoreInput supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <backup supported='yes'/>
Nov 15 05:34:49 user nova-compute[75648]:     <sev supported='no'/>
Nov 15 05:34:49 user nova-compute[75648]:   </features>
Nov 15 05:34:49 user nova-compute[75648]: </domainCapabilities>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75648) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75648) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Checking secure boot support for host arch (x86_64) {{(pid=75648) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Checking secure boot support for host arch (x86_64) {{(pid=75648) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Checking secure boot support for host arch (x86_64) {{(pid=75648) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Checking secure boot support for host arch (x86_64) {{(pid=75648) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Checking secure boot support for host arch (x86_64) {{(pid=75648) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 15 05:34:49 user nova-compute[75648]: INFO nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Secure Boot support detected
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] cpu compare xml: <cpu match="exact">
Nov 15 05:34:49 user nova-compute[75648]:   <model>Nehalem</model>
Nov 15 05:34:49 user nova-compute[75648]: </cpu>
Nov 15 05:34:49 user nova-compute[75648]:  {{(pid=75648) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 15 05:34:49 user nova-compute[75648]: INFO nova.virt.node [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Generated node identity 2afde26c-116f-40d4-b607-8ec699f44de3
Nov 15 05:34:49 user nova-compute[75648]: INFO nova.virt.node [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Wrote node identity 2afde26c-116f-40d4-b607-8ec699f44de3 to /opt/stack/data/nova/compute_id
Nov 15 05:34:49 user nova-compute[75648]: WARNING nova.compute.manager [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Compute nodes ['2afde26c-116f-40d4-b607-8ec699f44de3'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 15 05:34:49 user nova-compute[75648]: INFO nova.compute.manager [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 15 05:34:49 user nova-compute[75648]: WARNING nova.compute.manager [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 15 05:34:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:34:49 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:34:49 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:34:49 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Hypervisor/Node resource view: name=user free_ram=10994MB free_disk=26.278308868408203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:34:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:34:49 user nova-compute[75648]: WARNING nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] No compute node record for user:2afde26c-116f-40d4-b607-8ec699f44de3: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 2afde26c-116f-40d4-b607-8ec699f44de3 could not be found.
Nov 15 05:34:49 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Compute node record created for user:user with uuid: 2afde26c-116f-40d4-b607-8ec699f44de3
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:34:50 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] [req-e8883f50-11b7-4072-9e35-745b2599a5fd] Created resource provider record via placement API for resource provider with UUID 2afde26c-116f-40d4-b607-8ec699f44de3 and name user.
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75648) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 15 05:34:50 user nova-compute[75648]: INFO nova.virt.libvirt.host [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] kernel doesn't support AMD SEV
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Libvirt baseline CPU <cpu>
Nov 15 05:34:50 user nova-compute[75648]:   <arch>x86_64</arch>
Nov 15 05:34:50 user nova-compute[75648]:   <model>Nehalem</model>
Nov 15 05:34:50 user nova-compute[75648]:   <vendor>Intel</vendor>
Nov 15 05:34:50 user nova-compute[75648]:   <topology sockets="6" cores="1" threads="1"/>
Nov 15 05:34:50 user nova-compute[75648]: </cpu>
Nov 15 05:34:50 user nova-compute[75648]:  {{(pid=75648) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Updated inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Updating resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 generation from 0 to 1 during operation: update_inventory {{(pid=75648) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Updating resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 generation from 1 to 2 during operation: update_traits {{(pid=75648) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.service [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Creating RPC server for service compute {{(pid=75648) start /opt/stack/nova/nova/service.py:182}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.service [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] Join ServiceGroup membership for this service compute {{(pid=75648) start /opt/stack/nova/nova/service.py:199}}
Nov 15 05:34:50 user nova-compute[75648]: DEBUG nova.servicegroup.drivers.db [None req-0155e668-e384-48ac-a90f-c9b26456c23d None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75648) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 15 05:35:26 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_power_states {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:26 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:35:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:35:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=10430MB free_disk=26.182159423828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:35:41 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:35:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:35:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:36:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:36:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:36:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=10369MB free_disk=26.246505737304688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:42 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:36:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:36:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:36:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 05:36:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:36:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:37:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:37:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:37:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=10408MB free_disk=25.998916625976562GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:37:41 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:37:42 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:37:42 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:37:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:37:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:37:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:37:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:37:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:37:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 05:37:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:37:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:38:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=9665MB free_disk=26.027000427246094GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:42 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:43 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:38:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:38:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:48 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:38:49 user nova-compute[75648]: INFO nova.compute.claims [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Claim successful on node user
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.173s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:38:49 user nova-compute[75648]: INFO nova.compute.claims [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Claim successful on node user
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:38:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.296s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:38:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:38:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Creating image(s)
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.policy [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e20600cd4fd148b1b871195e1e5397d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba132e2da344b8da008767a69ba0f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.policy [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47b4817a59584433a28790c3a16d0b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13f9a55b45f4f9992e2f86628b34982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.part --force-share --output=json" returned: 0 in 0.199s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.virt.images [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] 72e9a4f4-242e-472f-a069-4362bff1d397 was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.part /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:38:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Creating image(s)
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "/opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.part /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.converted" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.119s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:51 user nova-compute[75648]: INFO oslo.privsep.daemon [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpi1rkhcg7/privsep.sock']
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.317s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:38:51 user nova-compute[75648]: INFO nova.compute.claims [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Claim successful on node user
Nov 15 05:38:51 user sudo[84909]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpi1rkhcg7/privsep.sock
Nov 15 05:38:51 user sudo[84909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.481s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:38:51 user nova-compute[75648]: INFO nova.compute.claims [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Claim successful on node user
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:38:51 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.policy [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bd09324c4634b8b820c49b51752a688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08f06fc4de745b589b4db3c2147e43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:38:51 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Creating image(s)
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.769s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:38:52 user nova-compute[75648]: INFO nova.compute.claims [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Claim successful on node user
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:38:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:38:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Creating image(s)
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "/opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "/opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "/opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Successfully created port: 563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Successfully created port: 589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:38:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.policy [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd58a0aa9d3a3414b9a9e16385495c354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0129d4b74f2b4e8fb0214cc31ec5f23e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:38:52 user sudo[84909]: pam_unix(sudo:session): session closed for user root
Nov 15 05:38:52 user nova-compute[75648]: INFO oslo.privsep.daemon [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Spawned new privsep daemon via rootwrap
Nov 15 05:38:52 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 05:38:52 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 05:38:52 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 15 05:38:52 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84913
Nov 15 05:38:52 user nova-compute[75648]: WARNING oslo_privsep.priv_context [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] privsep daemon already running
Nov 15 05:38:52 user nova-compute[75648]: WARNING oslo_privsep.priv_context [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] privsep daemon already running
Nov 15 05:38:52 user nova-compute[75648]: WARNING oslo_privsep.priv_context [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] privsep daemon already running
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:38:52 user nova-compute[75648]: INFO nova.compute.claims [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Claim successful on node user
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:38:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Creating image(s)
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG nova.policy [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e20600cd4fd148b1b871195e1e5397d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba132e2da344b8da008767a69ba0f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:38:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.163s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk 1073741824" returned: 0 in 0.041s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.209s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:38:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:38:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Creating image(s)
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk 1073741824" returned: 0 in 0.103s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.528s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Cannot resize image /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Ensure instance console log exists: /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:53 user nova-compute[75648]: DEBUG nova.policy [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '221c346b396e424a8b56b182afbb77d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '774de78f8d8b498d8b67c7c7d439eb6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Cannot resize image /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Ensure instance console log exists: /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk 1073741824" returned: 0 in 0.149s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Successfully created port: f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.864s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.200s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.202s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk 1073741824" returned: 0 in 0.055s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 1.106s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Cannot resize image /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Ensure instance console log exists: /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.168s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.228s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk 1073741824" returned: 0 in 0.068s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.812s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Successfully created port: 2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Cannot resize image /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Ensure instance console log exists: /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk 1073741824" returned: 0 in 0.046s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Cannot resize image /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Ensure instance console log exists: /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Successfully updated port: 589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Cannot resize image /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Ensure instance console log exists: /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-changed-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Refreshing instance network info cache due to event network-changed-589ad79a-ee59-4272-ab7b-d00c3c8b7610. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] Acquiring lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Successfully created port: 893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Successfully updated port: 563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-changed-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Refreshing instance network info cache due to event network-changed-563c8454-c7b5-4d8f-9c22-a8da90b69a3a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Instance network_info: |[{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] Acquired lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Refreshing network info cache for port 589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Start _get_guest_xml network_info=[{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:38:56 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:56 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-91853311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-91853311',id=2,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-82iqqsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:50Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=f66dc876-aae4-4e20-8b96-c47a8e3dff60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'pci_devices' on Instance uuid f66dc876-aae4-4e20-8b96-c47a8e3dff60 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:38:56 user nova-compute[75648]:   <uuid>f66dc876-aae4-4e20-8b96-c47a8e3dff60</uuid>
Nov 15 05:38:56 user nova-compute[75648]:   <name>instance-00000002</name>
Nov 15 05:38:56 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:38:56 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:38:56 user nova-compute[75648]:   <metadata>
Nov 15 05:38:56 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:38:56 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:38:56 user nova-compute[75648]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-91853311</nova:name>
Nov 15 05:38:56 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:38:56</nova:creationTime>
Nov 15 05:38:56 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:38:56 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:38:56 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:38:56 user nova-compute[75648]:       <nova:owner>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:user uuid="47b4817a59584433a28790c3a16d0b5c">tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member</nova:user>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:project uuid="c13f9a55b45f4f9992e2f86628b34982">tempest-ServerBootFromVolumeStableRescueTest-893883912</nova:project>
Nov 15 05:38:56 user nova-compute[75648]:       </nova:owner>
Nov 15 05:38:56 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:38:56 user nova-compute[75648]:       <nova:ports>
Nov 15 05:38:56 user nova-compute[75648]:         <nova:port uuid="589ad79a-ee59-4272-ab7b-d00c3c8b7610">
Nov 15 05:38:56 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:38:56 user nova-compute[75648]:         </nova:port>
Nov 15 05:38:56 user nova-compute[75648]:       </nova:ports>
Nov 15 05:38:56 user nova-compute[75648]:     </nova:instance>
Nov 15 05:38:56 user nova-compute[75648]:   </metadata>
Nov 15 05:38:56 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:38:56 user nova-compute[75648]:     <system>
Nov 15 05:38:56 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:38:56 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:38:56 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:38:56 user nova-compute[75648]:       <entry name="serial">f66dc876-aae4-4e20-8b96-c47a8e3dff60</entry>
Nov 15 05:38:56 user nova-compute[75648]:       <entry name="uuid">f66dc876-aae4-4e20-8b96-c47a8e3dff60</entry>
Nov 15 05:38:56 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:38:56 user nova-compute[75648]:     </system>
Nov 15 05:38:56 user nova-compute[75648]:   </sysinfo>
Nov 15 05:38:56 user nova-compute[75648]:   <os>
Nov 15 05:38:56 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:38:56 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:38:56 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:38:56 user nova-compute[75648]:   </os>
Nov 15 05:38:56 user nova-compute[75648]:   <features>
Nov 15 05:38:56 user nova-compute[75648]:     <acpi/>
Nov 15 05:38:56 user nova-compute[75648]:     <apic/>
Nov 15 05:38:56 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:38:56 user nova-compute[75648]:   </features>
Nov 15 05:38:56 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:38:56 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:38:56 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:38:56 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:38:56 user nova-compute[75648]:   </clock>
Nov 15 05:38:56 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:38:56 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:38:56 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:38:56 user nova-compute[75648]:   </cpu>
Nov 15 05:38:56 user nova-compute[75648]:   <devices>
Nov 15 05:38:56 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:38:56 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:38:56 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk"/>
Nov 15 05:38:56 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:38:56 user nova-compute[75648]:     </disk>
Nov 15 05:38:56 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:38:56 user nova-compute[75648]:       <mac address="fa:16:3e:3a:cd:89"/>
Nov 15 05:38:56 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:56 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:38:56 user nova-compute[75648]:       <target dev="tap589ad79a-ee"/>
Nov 15 05:38:56 user nova-compute[75648]:     </interface>
Nov 15 05:38:56 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:38:56 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/console.log" append="off"/>
Nov 15 05:38:56 user nova-compute[75648]:     </serial>
Nov 15 05:38:56 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:38:56 user nova-compute[75648]:     <video>
Nov 15 05:38:56 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:56 user nova-compute[75648]:     </video>
Nov 15 05:38:56 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:38:56 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:38:56 user nova-compute[75648]:     </rng>
Nov 15 05:38:56 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:38:56 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:38:56 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:38:56 user nova-compute[75648]:     </memballoon>
Nov 15 05:38:56 user nova-compute[75648]:   </devices>
Nov 15 05:38:56 user nova-compute[75648]: </domain>
Nov 15 05:38:56 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-91853311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-91853311',id=2,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-82iqqsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:50Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=f66dc876-aae4-4e20-8b96-c47a8e3dff60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG os_vif [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Created schema index Interface.name {{(pid=75648) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Created schema index Port.name {{(pid=75648) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Created schema index Bridge.name {{(pid=75648) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [POLLOUT] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Successfully created port: c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '908d8bb6-b213-5736-a65c-cd7305e71156', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:56 user nova-compute[75648]: INFO oslo.privsep.daemon [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp4m_u5_xs/privsep.sock']
Nov 15 05:38:56 user sudo[85015]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp4m_u5_xs/privsep.sock
Nov 15 05:38:56 user sudo[85015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Successfully updated port: f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance network_info: |[{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.neutron [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Refreshing network info cache for port 563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Start _get_guest_xml network_info=[{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:38:57 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:57 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-618512900',display_name='tempest-ServerRescueNegativeTestJSON-server-618512900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-618512900',id=1,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-e00zqohb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:50Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=c6859cea-129c-472b-aba0-b609ddc5f89a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'pci_devices' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:38:57 user nova-compute[75648]:   <uuid>c6859cea-129c-472b-aba0-b609ddc5f89a</uuid>
Nov 15 05:38:57 user nova-compute[75648]:   <name>instance-00000001</name>
Nov 15 05:38:57 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:38:57 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:38:57 user nova-compute[75648]:   <metadata>
Nov 15 05:38:57 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:38:57 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:38:57 user nova-compute[75648]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-618512900</nova:name>
Nov 15 05:38:57 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:38:57</nova:creationTime>
Nov 15 05:38:57 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:38:57 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:38:57 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:38:57 user nova-compute[75648]:       <nova:owner>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:user uuid="e20600cd4fd148b1b871195e1e5397d7">tempest-ServerRescueNegativeTestJSON-1116175393-project-member</nova:user>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:project uuid="1ba132e2da344b8da008767a69ba0f3f">tempest-ServerRescueNegativeTestJSON-1116175393</nova:project>
Nov 15 05:38:57 user nova-compute[75648]:       </nova:owner>
Nov 15 05:38:57 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:38:57 user nova-compute[75648]:       <nova:ports>
Nov 15 05:38:57 user nova-compute[75648]:         <nova:port uuid="563c8454-c7b5-4d8f-9c22-a8da90b69a3a">
Nov 15 05:38:57 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 05:38:57 user nova-compute[75648]:         </nova:port>
Nov 15 05:38:57 user nova-compute[75648]:       </nova:ports>
Nov 15 05:38:57 user nova-compute[75648]:     </nova:instance>
Nov 15 05:38:57 user nova-compute[75648]:   </metadata>
Nov 15 05:38:57 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:38:57 user nova-compute[75648]:     <system>
Nov 15 05:38:57 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:38:57 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:38:57 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:38:57 user nova-compute[75648]:       <entry name="serial">c6859cea-129c-472b-aba0-b609ddc5f89a</entry>
Nov 15 05:38:57 user nova-compute[75648]:       <entry name="uuid">c6859cea-129c-472b-aba0-b609ddc5f89a</entry>
Nov 15 05:38:57 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:38:57 user nova-compute[75648]:     </system>
Nov 15 05:38:57 user nova-compute[75648]:   </sysinfo>
Nov 15 05:38:57 user nova-compute[75648]:   <os>
Nov 15 05:38:57 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:38:57 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:38:57 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:38:57 user nova-compute[75648]:   </os>
Nov 15 05:38:57 user nova-compute[75648]:   <features>
Nov 15 05:38:57 user nova-compute[75648]:     <acpi/>
Nov 15 05:38:57 user nova-compute[75648]:     <apic/>
Nov 15 05:38:57 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:38:57 user nova-compute[75648]:   </features>
Nov 15 05:38:57 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:38:57 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:38:57 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:38:57 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:38:57 user nova-compute[75648]:   </clock>
Nov 15 05:38:57 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:38:57 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:38:57 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:38:57 user nova-compute[75648]:   </cpu>
Nov 15 05:38:57 user nova-compute[75648]:   <devices>
Nov 15 05:38:57 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:38:57 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:38:57 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk"/>
Nov 15 05:38:57 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:38:57 user nova-compute[75648]:     </disk>
Nov 15 05:38:57 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:38:57 user nova-compute[75648]:       <mac address="fa:16:3e:6a:e8:00"/>
Nov 15 05:38:57 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:57 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:38:57 user nova-compute[75648]:       <target dev="tap563c8454-c7"/>
Nov 15 05:38:57 user nova-compute[75648]:     </interface>
Nov 15 05:38:57 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:38:57 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/console.log" append="off"/>
Nov 15 05:38:57 user nova-compute[75648]:     </serial>
Nov 15 05:38:57 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:38:57 user nova-compute[75648]:     <video>
Nov 15 05:38:57 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:57 user nova-compute[75648]:     </video>
Nov 15 05:38:57 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:38:57 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:38:57 user nova-compute[75648]:     </rng>
Nov 15 05:38:57 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:38:57 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:38:57 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:38:57 user nova-compute[75648]:     </memballoon>
Nov 15 05:38:57 user nova-compute[75648]:   </devices>
Nov 15 05:38:57 user nova-compute[75648]: </domain>
Nov 15 05:38:57 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-618512900',display_name='tempest-ServerRescueNegativeTestJSON-server-618512900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-618512900',id=1,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-e00zqohb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:50Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=c6859cea-129c-472b-aba0-b609ddc5f89a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG os_vif [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cd3e949-211c-5b91-a80a-3ca03b55e928', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Successfully updated port: 2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing instance network info cache due to event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updated VIF entry in instance network info cache for port 589ad79a-ee59-4272-ab7b-d00c3c8b7610. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2e4601aa-8871-473b-bfed-cbbd74670b23 req-f2b0f530-cb31-41fd-b7a2-ceb117140350 service nova] Releasing lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance network_info: |[{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Start _get_guest_xml network_info=[{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:38:58 user sudo[85015]: pam_unix(sudo:session): session closed for user root
Nov 15 05:38:58 user nova-compute[75648]: INFO oslo.privsep.daemon [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Spawned new privsep daemon via rootwrap
Nov 15 05:38:58 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 05:38:58 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 05:38:58 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 15 05:38:58 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85018
Nov 15 05:38:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-66321000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-66321000',id=4,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDT+QGtGruou8hlWAeV8P8X62pba6X7eOjVaz/tvu5u3SCbGg/SxnXOtKGrikVZrRneh/S1kvQSGR2M/f/nHBiMy9u1xauxL+Y3J+AuoDGdIUtVKPP72cn9HYYFfyNF3cQ==',key_name='tempest-keypair-2114855632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-0dc600ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=4d78e23e-b1d9-4395-9885-c515e558f673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.objects.instance [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:38:58 user nova-compute[75648]: WARNING oslo_privsep.priv_context [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] privsep daemon already running
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:38:58 user nova-compute[75648]:   <uuid>4d78e23e-b1d9-4395-9885-c515e558f673</uuid>
Nov 15 05:38:58 user nova-compute[75648]:   <name>instance-00000004</name>
Nov 15 05:38:58 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:38:58 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:38:58 user nova-compute[75648]:   <metadata>
Nov 15 05:38:58 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:38:58 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-66321000</nova:name>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:38:58</nova:creationTime>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:38:58 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:38:58 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:owner>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:user uuid="8bd09324c4634b8b820c49b51752a688">tempest-AttachVolumeShelveTestJSON-1500760960-project-member</nova:user>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:project uuid="a08f06fc4de745b589b4db3c2147e43d">tempest-AttachVolumeShelveTestJSON-1500760960</nova:project>
Nov 15 05:38:58 user nova-compute[75648]:       </nova:owner>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:ports>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:port uuid="f91e5406-2b2a-45e8-86a4-81edc6a8a06f">
Nov 15 05:38:58 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:38:58 user nova-compute[75648]:         </nova:port>
Nov 15 05:38:58 user nova-compute[75648]:       </nova:ports>
Nov 15 05:38:58 user nova-compute[75648]:     </nova:instance>
Nov 15 05:38:58 user nova-compute[75648]:   </metadata>
Nov 15 05:38:58 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:38:58 user nova-compute[75648]:     <system>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="serial">4d78e23e-b1d9-4395-9885-c515e558f673</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="uuid">4d78e23e-b1d9-4395-9885-c515e558f673</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:38:58 user nova-compute[75648]:     </system>
Nov 15 05:38:58 user nova-compute[75648]:   </sysinfo>
Nov 15 05:38:58 user nova-compute[75648]:   <os>
Nov 15 05:38:58 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:38:58 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:38:58 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:38:58 user nova-compute[75648]:   </os>
Nov 15 05:38:58 user nova-compute[75648]:   <features>
Nov 15 05:38:58 user nova-compute[75648]:     <acpi/>
Nov 15 05:38:58 user nova-compute[75648]:     <apic/>
Nov 15 05:38:58 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:38:58 user nova-compute[75648]:   </features>
Nov 15 05:38:58 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:38:58 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:38:58 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:38:58 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:38:58 user nova-compute[75648]:   </clock>
Nov 15 05:38:58 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:38:58 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:38:58 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:38:58 user nova-compute[75648]:   </cpu>
Nov 15 05:38:58 user nova-compute[75648]:   <devices>
Nov 15 05:38:58 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:38:58 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:38:58 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk"/>
Nov 15 05:38:58 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:38:58 user nova-compute[75648]:     </disk>
Nov 15 05:38:58 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:38:58 user nova-compute[75648]:       <mac address="fa:16:3e:ad:9b:17"/>
Nov 15 05:38:58 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:58 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:38:58 user nova-compute[75648]:       <target dev="tapf91e5406-2b"/>
Nov 15 05:38:58 user nova-compute[75648]:     </interface>
Nov 15 05:38:58 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:38:58 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/console.log" append="off"/>
Nov 15 05:38:58 user nova-compute[75648]:     </serial>
Nov 15 05:38:58 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:38:58 user nova-compute[75648]:     <video>
Nov 15 05:38:58 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:58 user nova-compute[75648]:     </video>
Nov 15 05:38:58 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:38:58 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:38:58 user nova-compute[75648]:     </rng>
Nov 15 05:38:58 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:38:58 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:38:58 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:38:58 user nova-compute[75648]:     </memballoon>
Nov 15 05:38:58 user nova-compute[75648]:   </devices>
Nov 15 05:38:58 user nova-compute[75648]: </domain>
Nov 15 05:38:58 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-66321000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-66321000',id=4,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDT+QGtGruou8hlWAeV8P8X62pba6X7eOjVaz/tvu5u3SCbGg/SxnXOtKGrikVZrRneh/S1kvQSGR2M/f/nHBiMy9u1xauxL+Y3J+AuoDGdIUtVKPP72cn9HYYFfyNF3cQ==',key_name='tempest-keypair-2114855632',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-0dc600ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=4d78e23e-b1d9-4395-9885-c515e558f673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG os_vif [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddd42c3d-9b64-5e26-96c5-8c24af25d483', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Successfully updated port: 893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance network_info: |[{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Start _get_guest_xml network_info=[{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:38:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "refresh_cache-5d79d7ce-24cf-4a16-8e0f-769417a4bece" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquired lock "refresh_cache-5d79d7ce-24cf-4a16-8e0f-769417a4bece" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1801397757',display_name='tempest-ServerRescueNegativeTestJSON-server-1801397757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1801397757',id=3,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-ictjapfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:53Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=50d2b30f-82e8-46fe-8a7b-f227ba756995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'pci_devices' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updated VIF entry in instance network info cache for port 563c8454-c7b5-4d8f-9c22-a8da90b69a3a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-changed-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Refreshing instance network info cache due to event network-changed-893338cf-60d8-4816-b724-9c0c18ea0eb2. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] Acquiring lock "refresh_cache-5d79d7ce-24cf-4a16-8e0f-769417a4bece" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:38:58 user nova-compute[75648]:   <uuid>50d2b30f-82e8-46fe-8a7b-f227ba756995</uuid>
Nov 15 05:38:58 user nova-compute[75648]:   <name>instance-00000003</name>
Nov 15 05:38:58 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:38:58 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:38:58 user nova-compute[75648]:   <metadata>
Nov 15 05:38:58 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:38:58 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1801397757</nova:name>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:38:58</nova:creationTime>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:38:58 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:38:58 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:owner>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:user uuid="e20600cd4fd148b1b871195e1e5397d7">tempest-ServerRescueNegativeTestJSON-1116175393-project-member</nova:user>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:project uuid="1ba132e2da344b8da008767a69ba0f3f">tempest-ServerRescueNegativeTestJSON-1116175393</nova:project>
Nov 15 05:38:58 user nova-compute[75648]:       </nova:owner>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:38:58 user nova-compute[75648]:       <nova:ports>
Nov 15 05:38:58 user nova-compute[75648]:         <nova:port uuid="2322248d-0c65-4479-a167-4070d5a5d87e">
Nov 15 05:38:58 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 05:38:58 user nova-compute[75648]:         </nova:port>
Nov 15 05:38:58 user nova-compute[75648]:       </nova:ports>
Nov 15 05:38:58 user nova-compute[75648]:     </nova:instance>
Nov 15 05:38:58 user nova-compute[75648]:   </metadata>
Nov 15 05:38:58 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:38:58 user nova-compute[75648]:     <system>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="serial">50d2b30f-82e8-46fe-8a7b-f227ba756995</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="uuid">50d2b30f-82e8-46fe-8a7b-f227ba756995</entry>
Nov 15 05:38:58 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:38:58 user nova-compute[75648]:     </system>
Nov 15 05:38:58 user nova-compute[75648]:   </sysinfo>
Nov 15 05:38:58 user nova-compute[75648]:   <os>
Nov 15 05:38:58 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:38:58 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:38:58 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:38:58 user nova-compute[75648]:   </os>
Nov 15 05:38:58 user nova-compute[75648]:   <features>
Nov 15 05:38:58 user nova-compute[75648]:     <acpi/>
Nov 15 05:38:58 user nova-compute[75648]:     <apic/>
Nov 15 05:38:58 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:38:58 user nova-compute[75648]:   </features>
Nov 15 05:38:58 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:38:58 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:38:58 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:38:58 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:38:58 user nova-compute[75648]:   </clock>
Nov 15 05:38:58 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:38:58 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:38:58 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:38:58 user nova-compute[75648]:   </cpu>
Nov 15 05:38:58 user nova-compute[75648]:   <devices>
Nov 15 05:38:58 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:38:58 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:38:58 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk"/>
Nov 15 05:38:58 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:38:58 user nova-compute[75648]:     </disk>
Nov 15 05:38:58 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:38:58 user nova-compute[75648]:       <mac address="fa:16:3e:a5:f2:32"/>
Nov 15 05:38:58 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:58 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:38:58 user nova-compute[75648]:       <target dev="tap2322248d-0c"/>
Nov 15 05:38:58 user nova-compute[75648]:     </interface>
Nov 15 05:38:58 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:38:58 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/console.log" append="off"/>
Nov 15 05:38:58 user nova-compute[75648]:     </serial>
Nov 15 05:38:58 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:38:58 user nova-compute[75648]:     <video>
Nov 15 05:38:58 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:38:58 user nova-compute[75648]:     </video>
Nov 15 05:38:58 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:38:58 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:38:58 user nova-compute[75648]:     </rng>
Nov 15 05:38:58 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:38:58 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:38:58 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:38:58 user nova-compute[75648]:     </memballoon>
Nov 15 05:38:58 user nova-compute[75648]:   </devices>
Nov 15 05:38:58 user nova-compute[75648]: </domain>
Nov 15 05:38:58 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1801397757',display_name='tempest-ServerRescueNegativeTestJSON-server-1801397757',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1801397757',id=3,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-ictjapfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:53Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=50d2b30f-82e8-46fe-8a7b-f227ba756995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG os_vif [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4353aa2b-c7a2-5f5d-a986-06f33bf42c8b', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1b99e958-09f6-4be6-8413-ad7ff0e379df req-a9613434-5569-4922-8c55-e54ab195d3a7 service nova] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap589ad79a-ee, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap589ad79a-ee, col_values=(('qos', UUID('3c749b92-d4f4-4ab2-8210-97f2d4df9b5f')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap589ad79a-ee, col_values=(('external_ids', {'iface-id': '589ad79a-ee59-4272-ab7b-d00c3c8b7610', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:cd:89', 'vm-uuid': 'f66dc876-aae4-4e20-8b96-c47a8e3dff60'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: INFO os_vif [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee')
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap563c8454-c7, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap563c8454-c7, col_values=(('qos', UUID('0965ebeb-bf3c-48eb-8dc4-eb7c5a49ce0d')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap563c8454-c7, col_values=(('external_ids', {'iface-id': '563c8454-c7b5-4d8f-9c22-a8da90b69a3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:e8:00', 'vm-uuid': 'c6859cea-129c-472b-aba0-b609ddc5f89a'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: INFO os_vif [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7')
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2322248d-0c, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2322248d-0c, col_values=(('qos', UUID('f1df1faf-bb69-4a3e-a2ed-582293489580')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2322248d-0c, col_values=(('external_ids', {'iface-id': '2322248d-0c65-4479-a167-4070d5a5d87e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:f2:32', 'vm-uuid': '50d2b30f-82e8-46fe-8a7b-f227ba756995'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: INFO os_vif [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c')
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf91e5406-2b, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf91e5406-2b, col_values=(('qos', UUID('329dac08-344f-45e2-94cf-f436f25bfc2e')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf91e5406-2b, col_values=(('external_ids', {'iface-id': 'f91e5406-2b2a-45e8-86a4-81edc6a8a06f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:9b:17', 'vm-uuid': '4d78e23e-b1d9-4395-9885-c515e558f673'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No VIF found with MAC fa:16:3e:3a:cd:89, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:38:58 user nova-compute[75648]: INFO os_vif [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b')
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:38:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:6a:e8:00, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:a5:f2:32, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No VIF found with MAC fa:16:3e:ad:9b:17, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Successfully updated port: c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updated VIF entry in instance network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-14a6b095-7547-4811-9d29-a8f3d4fff8c6 req-c4ec1de5-0a7b-4a03-beb0-a374833771cc service nova] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-changed-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Refreshing instance network info cache due to event network-changed-2322248d-0c65-4479-a167-4070d5a5d87e. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] Acquiring lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] Acquired lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Refreshing network info cache for port 2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing instance network info cache due to event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Updating instance_info_cache with network_info: [{"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Releasing lock "refresh_cache-5d79d7ce-24cf-4a16-8e0f-769417a4bece" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Instance network_info: |[{"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] Acquired lock "refresh_cache-5d79d7ce-24cf-4a16-8e0f-769417a4bece" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Refreshing network info cache for port 893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Start _get_guest_xml network_info=[{"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:38:59 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:59 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1780391563',display_name='tempest-DeleteServersTestJSON-server-1780391563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1780391563',id=5,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0129d4b74f2b4e8fb0214cc31ec5f23e',ramdisk_id='',reservation_id='r-dnklwsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1085885807',owner_user_name='tempest-DeleteServersTestJSON-1085885807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:52Z,user_data=None,user_id='d58a0aa9d3a3414b9a9e16385495c354',uuid=5d79d7ce-24cf-4a16-8e0f-769417a4bece,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Converting VIF {"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:38:59 user nova-compute[75648]: DEBUG nova.objects.instance [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lazy-loading 'pci_devices' on Instance uuid 5d79d7ce-24cf-4a16-8e0f-769417a4bece {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:00 user nova-compute[75648]:   <uuid>5d79d7ce-24cf-4a16-8e0f-769417a4bece</uuid>
Nov 15 05:39:00 user nova-compute[75648]:   <name>instance-00000005</name>
Nov 15 05:39:00 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:00 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:00 user nova-compute[75648]:   <metadata>
Nov 15 05:39:00 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:00 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:00 user nova-compute[75648]:       <nova:name>tempest-DeleteServersTestJSON-server-1780391563</nova:name>
Nov 15 05:39:00 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:38:59</nova:creationTime>
Nov 15 05:39:00 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:00 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:00 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:00 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:user uuid="d58a0aa9d3a3414b9a9e16385495c354">tempest-DeleteServersTestJSON-1085885807-project-member</nova:user>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:project uuid="0129d4b74f2b4e8fb0214cc31ec5f23e">tempest-DeleteServersTestJSON-1085885807</nova:project>
Nov 15 05:39:00 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:00 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:39:00 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:00 user nova-compute[75648]:         <nova:port uuid="893338cf-60d8-4816-b724-9c0c18ea0eb2">
Nov 15 05:39:00 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:39:00 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:00 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:00 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:00 user nova-compute[75648]:   </metadata>
Nov 15 05:39:00 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:00 user nova-compute[75648]:     <system>
Nov 15 05:39:00 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:00 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:00 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:00 user nova-compute[75648]:       <entry name="serial">5d79d7ce-24cf-4a16-8e0f-769417a4bece</entry>
Nov 15 05:39:00 user nova-compute[75648]:       <entry name="uuid">5d79d7ce-24cf-4a16-8e0f-769417a4bece</entry>
Nov 15 05:39:00 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:00 user nova-compute[75648]:     </system>
Nov 15 05:39:00 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:00 user nova-compute[75648]:   <os>
Nov 15 05:39:00 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:00 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:00 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:00 user nova-compute[75648]:   </os>
Nov 15 05:39:00 user nova-compute[75648]:   <features>
Nov 15 05:39:00 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:00 user nova-compute[75648]:     <apic/>
Nov 15 05:39:00 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:00 user nova-compute[75648]:   </features>
Nov 15 05:39:00 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:00 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:00 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:00 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:00 user nova-compute[75648]:   </clock>
Nov 15 05:39:00 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:00 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:00 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:00 user nova-compute[75648]:   </cpu>
Nov 15 05:39:00 user nova-compute[75648]:   <devices>
Nov 15 05:39:00 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:00 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:00 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk"/>
Nov 15 05:39:00 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:39:00 user nova-compute[75648]:     </disk>
Nov 15 05:39:00 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:00 user nova-compute[75648]:       <mac address="fa:16:3e:ca:cc:ad"/>
Nov 15 05:39:00 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:00 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:00 user nova-compute[75648]:       <target dev="tap893338cf-60"/>
Nov 15 05:39:00 user nova-compute[75648]:     </interface>
Nov 15 05:39:00 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:00 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/console.log" append="off"/>
Nov 15 05:39:00 user nova-compute[75648]:     </serial>
Nov 15 05:39:00 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:00 user nova-compute[75648]:     <video>
Nov 15 05:39:00 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:00 user nova-compute[75648]:     </video>
Nov 15 05:39:00 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:00 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:00 user nova-compute[75648]:     </rng>
Nov 15 05:39:00 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:00 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:00 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:00 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:00 user nova-compute[75648]:   </devices>
Nov 15 05:39:00 user nova-compute[75648]: </domain>
Nov 15 05:39:00 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1780391563',display_name='tempest-DeleteServersTestJSON-server-1780391563',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1780391563',id=5,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0129d4b74f2b4e8fb0214cc31ec5f23e',ramdisk_id='',reservation_id='r-dnklwsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1085885807',owner_user_name='tempest-DeleteServersTestJSON-1085885807-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:52Z,user_data=None,user_id='d58a0aa9d3a3414b9a9e16385495c354',uuid=5d79d7ce-24cf-4a16-8e0f-769417a4bece,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Converting VIF {"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG os_vif [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ca3e55a-ef53-56a9-ac13-87ac5ac516ed', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap893338cf-60, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap893338cf-60, col_values=(('qos', UUID('07b76ca2-5336-4f7a-96e6-4f696eb10ecd')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap893338cf-60, col_values=(('external_ids', {'iface-id': '893338cf-60d8-4816-b724-9c0c18ea0eb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:cc:ad', 'vm-uuid': '5d79d7ce-24cf-4a16-8e0f-769417a4bece'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:00 user nova-compute[75648]: INFO os_vif [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60')
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] No VIF found with MAC fa:16:3e:ca:cc:ad, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updated VIF entry in instance network info cache for port 2322248d-0c65-4479-a167-4070d5a5d87e. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8ea2c4d6-fe6c-4b49-be68-2323194ba623 req-5af7f550-e2e0-4eb5-b01d-8a9869aa7980 service nova] Releasing lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance network_info: |[{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Start _get_guest_xml network_info=[{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG nova.network.neutron [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Updated VIF entry in instance network info cache for port 893338cf-60d8-4816-b724-9c0c18ea0eb2. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG nova.network.neutron [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Updating instance_info_cache with network_info: [{"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b0c15ebd-b363-4b36-a808-2a1684540260 req-3e50c55d-ae26-4011-9a86-13191149816c service nova] Releasing lock "refresh_cache-5d79d7ce-24cf-4a16-8e0f-769417a4bece" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG nova.network.neutron [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updated VIF entry in instance network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG nova.network.neutron [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a5b493e2-a90c-4064-a7a3-d80a4a6280ff req-346ba329-7abe-4c8b-940e-f1f7d85fd73d service nova] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:07 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance spawned successfully.
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1707185365',display_name='tempest-ServerStableDeviceRescueTest-server-1707185365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1707185365',id=6,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7aCTB5xjLY8XRjEpsG5GPRei5HEfsSRDUaCLpKUzHWbT09vztqUYj9SGGreBtI+e/RPowDdLYQ0T/VofNNn174OW4JXawjcCPrNhyPxrBGohTsKIelmdMVhsrt0FPmg==',key_name='tempest-keypair-356891063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='774de78f8d8b498d8b67c7c7d439eb6f',ramdisk_id='',reservation_id='r-tdwwieo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1094356752',owner_user_name='tempest-ServerStableDeviceRescueTest-1094356752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221c346b396e424a8b56b182afbb77d9',uuid=fec7ed02-51fe-46d6-9d59-e6e21cb56e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converting VIF {"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'pci_devices' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:07 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance spawned successfully.
Nov 15 05:39:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:08 user nova-compute[75648]:   <uuid>fec7ed02-51fe-46d6-9d59-e6e21cb56e4c</uuid>
Nov 15 05:39:08 user nova-compute[75648]:   <name>instance-00000006</name>
Nov 15 05:39:08 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:08 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:08 user nova-compute[75648]:   <metadata>
Nov 15 05:39:08 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:08 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:08 user nova-compute[75648]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1707185365</nova:name>
Nov 15 05:39:08 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:39:07</nova:creationTime>
Nov 15 05:39:08 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:08 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:08 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:08 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:user uuid="221c346b396e424a8b56b182afbb77d9">tempest-ServerStableDeviceRescueTest-1094356752-project-member</nova:user>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:project uuid="774de78f8d8b498d8b67c7c7d439eb6f">tempest-ServerStableDeviceRescueTest-1094356752</nova:project>
Nov 15 05:39:08 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:08 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:39:08 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:08 user nova-compute[75648]:         <nova:port uuid="c780fe40-bbb3-4c6c-96c8-066f066fe06a">
Nov 15 05:39:08 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:39:08 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:08 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:08 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:08 user nova-compute[75648]:   </metadata>
Nov 15 05:39:08 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:08 user nova-compute[75648]:     <system>
Nov 15 05:39:08 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:08 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:08 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:08 user nova-compute[75648]:       <entry name="serial">fec7ed02-51fe-46d6-9d59-e6e21cb56e4c</entry>
Nov 15 05:39:08 user nova-compute[75648]:       <entry name="uuid">fec7ed02-51fe-46d6-9d59-e6e21cb56e4c</entry>
Nov 15 05:39:08 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:08 user nova-compute[75648]:     </system>
Nov 15 05:39:08 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:08 user nova-compute[75648]:   <os>
Nov 15 05:39:08 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:08 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:08 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:08 user nova-compute[75648]:   </os>
Nov 15 05:39:08 user nova-compute[75648]:   <features>
Nov 15 05:39:08 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:08 user nova-compute[75648]:     <apic/>
Nov 15 05:39:08 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:08 user nova-compute[75648]:   </features>
Nov 15 05:39:08 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:08 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:08 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:08 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:08 user nova-compute[75648]:   </clock>
Nov 15 05:39:08 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:08 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:08 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:08 user nova-compute[75648]:   </cpu>
Nov 15 05:39:08 user nova-compute[75648]:   <devices>
Nov 15 05:39:08 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:08 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:08 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk"/>
Nov 15 05:39:08 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:39:08 user nova-compute[75648]:     </disk>
Nov 15 05:39:08 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:08 user nova-compute[75648]:       <mac address="fa:16:3e:4c:49:4e"/>
Nov 15 05:39:08 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:08 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:08 user nova-compute[75648]:       <target dev="tapc780fe40-bb"/>
Nov 15 05:39:08 user nova-compute[75648]:     </interface>
Nov 15 05:39:08 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:08 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/console.log" append="off"/>
Nov 15 05:39:08 user nova-compute[75648]:     </serial>
Nov 15 05:39:08 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:08 user nova-compute[75648]:     <video>
Nov 15 05:39:08 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:08 user nova-compute[75648]:     </video>
Nov 15 05:39:08 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:08 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:08 user nova-compute[75648]:     </rng>
Nov 15 05:39:08 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:08 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:08 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:08 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:08 user nova-compute[75648]:   </devices>
Nov 15 05:39:08 user nova-compute[75648]: </domain>
Nov 15 05:39:08 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1707185365',display_name='tempest-ServerStableDeviceRescueTest-server-1707185365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1707185365',id=6,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7aCTB5xjLY8XRjEpsG5GPRei5HEfsSRDUaCLpKUzHWbT09vztqUYj9SGGreBtI+e/RPowDdLYQ0T/VofNNn174OW4JXawjcCPrNhyPxrBGohTsKIelmdMVhsrt0FPmg==',key_name='tempest-keypair-356891063',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='774de78f8d8b498d8b67c7c7d439eb6f',ramdisk_id='',reservation_id='r-tdwwieo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1094356752',owner_user_name='tempest-ServerStableDeviceRescueTest-1094356752-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221c346b396e424a8b56b182afbb77d9',uuid=fec7ed02-51fe-46d6-9d59-e6e21cb56e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converting VIF {"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG os_vif [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61d3487e-39c2-542c-ba10-c37ecbf5cd52', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc780fe40-bb, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc780fe40-bb, col_values=(('qos', UUID('e45a2a83-f0ea-4df0-986a-f80db20cdd27')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc780fe40-bb, col_values=(('external_ids', {'iface-id': 'c780fe40-bbb3-4c6c-96c8-066f066fe06a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:49:4e', 'vm-uuid': 'fec7ed02-51fe-46d6-9d59-e6e21cb56e4c'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:08 user nova-compute[75648]: INFO os_vif [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb')
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No VIF found with MAC fa:16:3e:4c:49:4e, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:08 user nova-compute[75648]: INFO nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Took 15.41 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:08 user nova-compute[75648]: INFO nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Took 18.65 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:08 user nova-compute[75648]: INFO nova.compute.manager [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Took 17.60 seconds to build instance.
Nov 15 05:39:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8f19a3a5-99c5-488f-a6cc-b578a4a3655d tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.896s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:08 user nova-compute[75648]: INFO nova.compute.manager [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Took 19.83 seconds to build instance.
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d7a0a19-af14-4dec-98dd-3b4fa5545f59 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.069s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Instance spawned successfully.
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:09 user nova-compute[75648]: INFO nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Took 18.51 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:09 user nova-compute[75648]: INFO nova.compute.manager [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Took 20.13 seconds to build instance.
Nov 15 05:39:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d3b5ae9d-3c37-4296-b863-93fe3ffcee93 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.398s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:10 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance spawned successfully.
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: INFO nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Took 18.36 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:10 user nova-compute[75648]: INFO nova.compute.manager [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Took 19.55 seconds to build instance.
Nov 15 05:39:10 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Instance spawned successfully.
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7821d6d4-e056-4b14-8c14-6e34f97d768c tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.768s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:10 user nova-compute[75648]: INFO nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Took 18.47 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:11 user nova-compute[75648]: INFO nova.compute.manager [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Took 20.08 seconds to build instance.
Nov 15 05:39:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-58cecc1b-4653-4b18-9a90-7043b3fe774c tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.280s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:39:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:39:12 user nova-compute[75648]: INFO nova.compute.claims [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Claim successful on node user
Nov 15 05:39:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.853s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.555s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:39:13 user nova-compute[75648]: INFO nova.compute.claims [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Claim successful on node user
Nov 15 05:39:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:39:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance spawned successfully.
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:39:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Creating image(s)
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "/opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "/opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "/opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:13 user nova-compute[75648]: DEBUG nova.policy [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd1cdbd2b9ea45099db6d6f2737b3a00', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d3b3cc220e400b9fd1e1d73d313159', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:14 user nova-compute[75648]: INFO nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Took 20.89 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.part --force-share --output=json" returned: 0 in 0.342s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG nova.virt.images [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.part /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:14 user nova-compute[75648]: INFO nova.compute.manager [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Took 22.15 seconds to build instance.
Nov 15 05:39:14 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:14 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53320443-dee7-474e-8592-02cd034f0131 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.313s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.715s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.part /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.converted" returned: 0 in 0.397s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:39:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:39:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0.converted --force-share --output=json" returned: 0 in 0.377s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.712s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:39:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Creating image(s)
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "/opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "/opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "/opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 --force-share --output=json" returned: 0 in 0.268s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.317s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.policy [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfefd577d6e44a2599e03538f036dd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109b77e151fd4fdbb160739d831a08e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 --force-share --output=json" returned: 0 in 0.285s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0,backing_fmt=raw /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0,backing_fmt=raw /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk 1073741824" returned: 0 in 0.068s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.362s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.305s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk 1073741824" returned: 0 in 0.119s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.432s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 --force-share --output=json" returned: 0 in 0.299s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Successfully created port: d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.289s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json" returned: 0 in 0.458s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Cannot resize image /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Ensure instance console log exists: /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.332s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Cannot resize image /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Ensure instance console log exists: /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:39:17 user nova-compute[75648]: INFO nova.compute.claims [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Claim successful on node user
Nov 15 05:39:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Successfully updated port: d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Successfully created port: c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquired lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-changed-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Refreshing instance network info cache due to event network-changed-d90f49d6-d3f5-4220-ae8d-13d52f62216f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] Acquiring lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:39:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.policy [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7765a4af7e94df98c56a63a6a8b9169', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '82a3d44380d943c0b587daaff4a27992', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updating instance_info_cache with network_info: [{"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:39:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Creating image(s)
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "/opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "/opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "/opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Releasing lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Instance network_info: |[{"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] Acquired lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Refreshing network info cache for port d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Start _get_guest_xml network_info=[{"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:39:03Z,direct_url=<?>,disk_format='qcow2',id=a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac,min_disk=0,min_ram=0,name='',owner='7d528527e27041d4b5b6c137b88173f4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:39:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'scsi', 'encryption_options': None, 'device_name': '/dev/sda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:39:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:39:03Z,direct_url=<?>,disk_format='qcow2',id=a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac,min_disk=0,min_ram=0,name='',owner='7d528527e27041d4b5b6c137b88173f4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:39:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:39:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1125550578',display_name='tempest-AttachSCSIVolumeTestJSON-server-1125550578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1125550578',id=7,image_ref='a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9Uqs25zaPUim1UtW2dDyekFU3sRvb7nskxGtLxOchgJOPI1skGIpL7SrQZcN5gcZwhNXaA+RmzXlnBfZMNuIBxQ65cSuac9zP5GE0yVa2XwbUCUUMKfOlGMk+B2Q+vVA==',key_name='tempest-keypair-537088292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d3b3cc220e400b9fd1e1d73d313159',ramdisk_id='',reservation_id='r-5426zyu2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-439021849',owner_user_name='tempest-AttachSCSIVolumeTestJSON-439021849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1cdbd2b9ea45099db6d6f2737b3a00',uuid=bd28591c-ff83-40f9-8298-9fab5de1dcbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Converting VIF {"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.objects.instance [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lazy-loading 'pci_devices' on Instance uuid bd28591c-ff83-40f9-8298-9fab5de1dcbc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:19 user nova-compute[75648]:   <uuid>bd28591c-ff83-40f9-8298-9fab5de1dcbc</uuid>
Nov 15 05:39:19 user nova-compute[75648]:   <name>instance-00000007</name>
Nov 15 05:39:19 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:19 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:19 user nova-compute[75648]:   <metadata>
Nov 15 05:39:19 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:19 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:19 user nova-compute[75648]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1125550578</nova:name>
Nov 15 05:39:19 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:39:18</nova:creationTime>
Nov 15 05:39:19 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:19 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:19 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:19 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:user uuid="cd1cdbd2b9ea45099db6d6f2737b3a00">tempest-AttachSCSIVolumeTestJSON-439021849-project-member</nova:user>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:project uuid="56d3b3cc220e400b9fd1e1d73d313159">tempest-AttachSCSIVolumeTestJSON-439021849</nova:project>
Nov 15 05:39:19 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:19 user nova-compute[75648]:       <nova:root type="image" uuid="a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac"/>
Nov 15 05:39:19 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:19 user nova-compute[75648]:         <nova:port uuid="d90f49d6-d3f5-4220-ae8d-13d52f62216f">
Nov 15 05:39:19 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:39:19 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:19 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:19 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:19 user nova-compute[75648]:   </metadata>
Nov 15 05:39:19 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:19 user nova-compute[75648]:     <system>
Nov 15 05:39:19 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:19 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:19 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:19 user nova-compute[75648]:       <entry name="serial">bd28591c-ff83-40f9-8298-9fab5de1dcbc</entry>
Nov 15 05:39:19 user nova-compute[75648]:       <entry name="uuid">bd28591c-ff83-40f9-8298-9fab5de1dcbc</entry>
Nov 15 05:39:19 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:19 user nova-compute[75648]:     </system>
Nov 15 05:39:19 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:19 user nova-compute[75648]:   <os>
Nov 15 05:39:19 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:19 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:19 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:19 user nova-compute[75648]:   </os>
Nov 15 05:39:19 user nova-compute[75648]:   <features>
Nov 15 05:39:19 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:19 user nova-compute[75648]:     <apic/>
Nov 15 05:39:19 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:19 user nova-compute[75648]:   </features>
Nov 15 05:39:19 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:19 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:19 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:19 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:19 user nova-compute[75648]:   </clock>
Nov 15 05:39:19 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:19 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:19 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:19 user nova-compute[75648]:   </cpu>
Nov 15 05:39:19 user nova-compute[75648]:   <devices>
Nov 15 05:39:19 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:19 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:19 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk"/>
Nov 15 05:39:19 user nova-compute[75648]:       <target dev="sda" bus="scsi"/>
Nov 15 05:39:19 user nova-compute[75648]:       <address type="drive" controller="0" unit="0"/>
Nov 15 05:39:19 user nova-compute[75648]:     </disk>
Nov 15 05:39:19 user nova-compute[75648]:     <disk type="file" device="cdrom">
Nov 15 05:39:19 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 05:39:19 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.config"/>
Nov 15 05:39:19 user nova-compute[75648]:       <target dev="sdb" bus="scsi"/>
Nov 15 05:39:19 user nova-compute[75648]:       <address type="drive" controller="0" unit="1"/>
Nov 15 05:39:19 user nova-compute[75648]:     </disk>
Nov 15 05:39:19 user nova-compute[75648]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 15 05:39:19 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:19 user nova-compute[75648]:       <mac address="fa:16:3e:31:15:86"/>
Nov 15 05:39:19 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:19 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:19 user nova-compute[75648]:       <target dev="tapd90f49d6-d3"/>
Nov 15 05:39:19 user nova-compute[75648]:     </interface>
Nov 15 05:39:19 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:19 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/console.log" append="off"/>
Nov 15 05:39:19 user nova-compute[75648]:     </serial>
Nov 15 05:39:19 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:19 user nova-compute[75648]:     <video>
Nov 15 05:39:19 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:19 user nova-compute[75648]:     </video>
Nov 15 05:39:19 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:19 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:19 user nova-compute[75648]:     </rng>
Nov 15 05:39:19 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:19 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:19 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:19 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:19 user nova-compute[75648]:   </devices>
Nov 15 05:39:19 user nova-compute[75648]: </domain>
Nov 15 05:39:19 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1125550578',display_name='tempest-AttachSCSIVolumeTestJSON-server-1125550578',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1125550578',id=7,image_ref='a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9Uqs25zaPUim1UtW2dDyekFU3sRvb7nskxGtLxOchgJOPI1skGIpL7SrQZcN5gcZwhNXaA+RmzXlnBfZMNuIBxQ65cSuac9zP5GE0yVa2XwbUCUUMKfOlGMk+B2Q+vVA==',key_name='tempest-keypair-537088292',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='56d3b3cc220e400b9fd1e1d73d313159',ramdisk_id='',reservation_id='r-5426zyu2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-439021849',owner_user_name='tempest-AttachSCSIVolumeTestJSON-439021849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1cdbd2b9ea45099db6d6f2737b3a00',uuid=bd28591c-ff83-40f9-8298-9fab5de1dcbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Converting VIF {"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG os_vif [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09c6d057-7e6c-5b76-acfd-24b232785b71', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd90f49d6-d3, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd90f49d6-d3, col_values=(('qos', UUID('e6153086-1a8c-4f69-9687-31dd2b08bf50')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd90f49d6-d3, col_values=(('external_ids', {'iface-id': 'd90f49d6-d3f5-4220-ae8d-13d52f62216f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:15:86', 'vm-uuid': 'bd28591c-ff83-40f9-8298-9fab5de1dcbc'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:19 user nova-compute[75648]: INFO os_vif [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3')
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.312s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Successfully updated port: c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquired lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No BDM found with device name sda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No VIF found with MAC fa:16:3e:31:15:86, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Using config drive
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-changed-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Refreshing instance network info cache due to event network-changed-c584c83b-4c1f-47ad-bbda-60412268bef6. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] Acquiring lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.297s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk 1073741824" returned: 0 in 0.098s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.neutron [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updated VIF entry in instance network info cache for port d90f49d6-d3f5-4220-ae8d-13d52f62216f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG nova.network.neutron [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updating instance_info_cache with network_info: [{"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f725e96-0b69-4fc2-8867-15fc39b2c274 req-6e06024e-eb48-44db-be28-0c0e044c347f service nova] Releasing lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.516s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Successfully created port: 76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Cannot resize image /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Ensure instance console log exists: /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updating instance_info_cache with network_info: [{"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Releasing lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Instance network_info: |[{"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] Acquired lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.neutron [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Refreshing network info cache for port c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Start _get_guest_xml network_info=[{"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:39:20 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:20 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1383988142',display_name='tempest-VolumesAdminNegativeTest-server-1383988142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1383988142',id=8,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLTRlVQuigqJPU0AgGyZ+8/hVqmBtMdr6VfQBS5rKZY9x9JuSSZQoN6pbdeZvNejBqXeDaVEQJi4REHhTN9ffB8OBI7LHPJNB/n9kxxrzpKBMbMhmhLRm7lJBI1jIlrJw==',key_name='tempest-keypair-1818642414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109b77e151fd4fdbb160739d831a08e1',ramdisk_id='',reservation_id='r-9vnp2q45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1862472137',owner_user_name='tempest-VolumesAdminNegativeTest-1862472137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfefd577d6e44a2599e03538f036dd18',uuid=177ad35a-a9fc-4c31-89d5-2592bb24bb4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converting VIF {"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'pci_devices' on Instance uuid 177ad35a-a9fc-4c31-89d5-2592bb24bb4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Creating config drive at /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.config
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt3y79m9j {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:20 user nova-compute[75648]:   <uuid>177ad35a-a9fc-4c31-89d5-2592bb24bb4c</uuid>
Nov 15 05:39:20 user nova-compute[75648]:   <name>instance-00000008</name>
Nov 15 05:39:20 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:20 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:20 user nova-compute[75648]:   <metadata>
Nov 15 05:39:20 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:20 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:20 user nova-compute[75648]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1383988142</nova:name>
Nov 15 05:39:20 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:39:20</nova:creationTime>
Nov 15 05:39:20 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:20 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:20 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:20 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:user uuid="cfefd577d6e44a2599e03538f036dd18">tempest-VolumesAdminNegativeTest-1862472137-project-member</nova:user>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:project uuid="109b77e151fd4fdbb160739d831a08e1">tempest-VolumesAdminNegativeTest-1862472137</nova:project>
Nov 15 05:39:20 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:20 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:39:20 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:20 user nova-compute[75648]:         <nova:port uuid="c584c83b-4c1f-47ad-bbda-60412268bef6">
Nov 15 05:39:20 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 05:39:20 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:20 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:20 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:20 user nova-compute[75648]:   </metadata>
Nov 15 05:39:20 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:20 user nova-compute[75648]:     <system>
Nov 15 05:39:20 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:20 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:20 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:20 user nova-compute[75648]:       <entry name="serial">177ad35a-a9fc-4c31-89d5-2592bb24bb4c</entry>
Nov 15 05:39:20 user nova-compute[75648]:       <entry name="uuid">177ad35a-a9fc-4c31-89d5-2592bb24bb4c</entry>
Nov 15 05:39:20 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:20 user nova-compute[75648]:     </system>
Nov 15 05:39:20 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:20 user nova-compute[75648]:   <os>
Nov 15 05:39:20 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:20 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:20 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:20 user nova-compute[75648]:   </os>
Nov 15 05:39:20 user nova-compute[75648]:   <features>
Nov 15 05:39:20 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:20 user nova-compute[75648]:     <apic/>
Nov 15 05:39:20 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:20 user nova-compute[75648]:   </features>
Nov 15 05:39:20 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:20 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:20 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:20 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:20 user nova-compute[75648]:   </clock>
Nov 15 05:39:20 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:20 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:20 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:20 user nova-compute[75648]:   </cpu>
Nov 15 05:39:20 user nova-compute[75648]:   <devices>
Nov 15 05:39:20 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:20 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:20 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk"/>
Nov 15 05:39:20 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:39:20 user nova-compute[75648]:     </disk>
Nov 15 05:39:20 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:20 user nova-compute[75648]:       <mac address="fa:16:3e:a1:6d:18"/>
Nov 15 05:39:20 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:20 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:20 user nova-compute[75648]:       <target dev="tapc584c83b-4c"/>
Nov 15 05:39:20 user nova-compute[75648]:     </interface>
Nov 15 05:39:20 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:20 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/console.log" append="off"/>
Nov 15 05:39:20 user nova-compute[75648]:     </serial>
Nov 15 05:39:20 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:20 user nova-compute[75648]:     <video>
Nov 15 05:39:20 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:20 user nova-compute[75648]:     </video>
Nov 15 05:39:20 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:20 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:20 user nova-compute[75648]:     </rng>
Nov 15 05:39:20 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:20 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:20 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:20 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:20 user nova-compute[75648]:   </devices>
Nov 15 05:39:20 user nova-compute[75648]: </domain>
Nov 15 05:39:20 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1383988142',display_name='tempest-VolumesAdminNegativeTest-server-1383988142',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1383988142',id=8,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLTRlVQuigqJPU0AgGyZ+8/hVqmBtMdr6VfQBS5rKZY9x9JuSSZQoN6pbdeZvNejBqXeDaVEQJi4REHhTN9ffB8OBI7LHPJNB/n9kxxrzpKBMbMhmhLRm7lJBI1jIlrJw==',key_name='tempest-keypair-1818642414',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109b77e151fd4fdbb160739d831a08e1',ramdisk_id='',reservation_id='r-9vnp2q45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1862472137',owner_user_name='tempest-VolumesAdminNegativeTest-1862472137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfefd577d6e44a2599e03538f036dd18',uuid=177ad35a-a9fc-4c31-89d5-2592bb24bb4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converting VIF {"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG os_vif [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpt3y79m9j" returned: 0 in 0.078s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0a63cf4-44ca-5071-998c-c23afcb55ba1', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc584c83b-4c, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc584c83b-4c, col_values=(('qos', UUID('5273f783-800c-462b-b919-7488bcb04c7e')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc584c83b-4c, col_values=(('external_ids', {'iface-id': 'c584c83b-4c1f-47ad-bbda-60412268bef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a1:6d:18', 'vm-uuid': '177ad35a-a9fc-4c31-89d5-2592bb24bb4c'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:20 user nova-compute[75648]: INFO os_vif [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c')
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No VIF found with MAC fa:16:3e:a1:6d:18, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updated VIF entry in instance network info cache for port c584c83b-4c1f-47ad-bbda-60412268bef6. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updating instance_info_cache with network_info: [{"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-93382a6a-c3c8-4fe5-b384-7d6852a14513 req-8a571aed-ec84-44b8-8511-6bf0edb319b1 service nova] Releasing lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Successfully updated port: 76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquired lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-changed-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Refreshing instance network info cache due to event network-changed-76b8b8e6-c430-4222-a726-7a45dd82c22b. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] Acquiring lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updating instance_info_cache with network_info: [{"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Releasing lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Instance network_info: |[{"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] Acquired lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Refreshing network info cache for port 76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Start _get_guest_xml network_info=[{"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:39:22 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:22 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1150969963',display_name='tempest-TestVolumeSwap-server-1150969963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1150969963',id=9,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANkAYrkjAjVkKNwjGvuLI9UHglgwq53W9numerFr+ftDDsGiu8SqskIQcMAqo9CzTF+UBvY6GCqX7s8QADY4ZA6LvCVMgnaVtQqs5sqLBfJhq3eJur/ro0747LifleNWg==',key_name='tempest-keypair-1784994168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82a3d44380d943c0b587daaff4a27992',ramdisk_id='',reservation_id='r-jpo2tgko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2065413912',owner_user_name='tempest-TestVolumeSwap-2065413912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7765a4af7e94df98c56a63a6a8b9169',uuid=38f6fbf6-3909-49d8-ab29-fb57a1727394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Converting VIF {"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lazy-loading 'pci_devices' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:22 user nova-compute[75648]:   <uuid>38f6fbf6-3909-49d8-ab29-fb57a1727394</uuid>
Nov 15 05:39:22 user nova-compute[75648]:   <name>instance-00000009</name>
Nov 15 05:39:22 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:22 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:22 user nova-compute[75648]:   <metadata>
Nov 15 05:39:22 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:22 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:22 user nova-compute[75648]:       <nova:name>tempest-TestVolumeSwap-server-1150969963</nova:name>
Nov 15 05:39:22 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:39:22</nova:creationTime>
Nov 15 05:39:22 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:22 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:22 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:22 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:user uuid="c7765a4af7e94df98c56a63a6a8b9169">tempest-TestVolumeSwap-2065413912-project-member</nova:user>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:project uuid="82a3d44380d943c0b587daaff4a27992">tempest-TestVolumeSwap-2065413912</nova:project>
Nov 15 05:39:22 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:22 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:39:22 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:22 user nova-compute[75648]:         <nova:port uuid="76b8b8e6-c430-4222-a726-7a45dd82c22b">
Nov 15 05:39:22 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 05:39:22 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:22 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:22 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:22 user nova-compute[75648]:   </metadata>
Nov 15 05:39:22 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:22 user nova-compute[75648]:     <system>
Nov 15 05:39:22 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:22 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:22 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:22 user nova-compute[75648]:       <entry name="serial">38f6fbf6-3909-49d8-ab29-fb57a1727394</entry>
Nov 15 05:39:22 user nova-compute[75648]:       <entry name="uuid">38f6fbf6-3909-49d8-ab29-fb57a1727394</entry>
Nov 15 05:39:22 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:22 user nova-compute[75648]:     </system>
Nov 15 05:39:22 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:22 user nova-compute[75648]:   <os>
Nov 15 05:39:22 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:22 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:22 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:22 user nova-compute[75648]:   </os>
Nov 15 05:39:22 user nova-compute[75648]:   <features>
Nov 15 05:39:22 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:22 user nova-compute[75648]:     <apic/>
Nov 15 05:39:22 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:22 user nova-compute[75648]:   </features>
Nov 15 05:39:22 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:22 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:22 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:22 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:22 user nova-compute[75648]:   </clock>
Nov 15 05:39:22 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:22 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:22 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:22 user nova-compute[75648]:   </cpu>
Nov 15 05:39:22 user nova-compute[75648]:   <devices>
Nov 15 05:39:22 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:22 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:22 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk"/>
Nov 15 05:39:22 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:39:22 user nova-compute[75648]:     </disk>
Nov 15 05:39:22 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:22 user nova-compute[75648]:       <mac address="fa:16:3e:70:be:15"/>
Nov 15 05:39:22 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:22 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:22 user nova-compute[75648]:       <target dev="tap76b8b8e6-c4"/>
Nov 15 05:39:22 user nova-compute[75648]:     </interface>
Nov 15 05:39:22 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:22 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/console.log" append="off"/>
Nov 15 05:39:22 user nova-compute[75648]:     </serial>
Nov 15 05:39:22 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:22 user nova-compute[75648]:     <video>
Nov 15 05:39:22 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:22 user nova-compute[75648]:     </video>
Nov 15 05:39:22 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:22 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:22 user nova-compute[75648]:     </rng>
Nov 15 05:39:22 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:22 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:22 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:22 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:22 user nova-compute[75648]:   </devices>
Nov 15 05:39:22 user nova-compute[75648]: </domain>
Nov 15 05:39:22 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1150969963',display_name='tempest-TestVolumeSwap-server-1150969963',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1150969963',id=9,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANkAYrkjAjVkKNwjGvuLI9UHglgwq53W9numerFr+ftDDsGiu8SqskIQcMAqo9CzTF+UBvY6GCqX7s8QADY4ZA6LvCVMgnaVtQqs5sqLBfJhq3eJur/ro0747LifleNWg==',key_name='tempest-keypair-1784994168',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='82a3d44380d943c0b587daaff4a27992',ramdisk_id='',reservation_id='r-jpo2tgko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2065413912',owner_user_name='tempest-TestVolumeSwap-2065413912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7765a4af7e94df98c56a63a6a8b9169',uuid=38f6fbf6-3909-49d8-ab29-fb57a1727394,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Converting VIF {"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG os_vif [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f914da9e-6c84-5017-a19f-e3ca5336b1b1', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76b8b8e6-c4, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76b8b8e6-c4, col_values=(('qos', UUID('483cb0a0-6097-442b-987d-0bc5c027e41a')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76b8b8e6-c4, col_values=(('external_ids', {'iface-id': '76b8b8e6-c430-4222-a726-7a45dd82c22b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:70:be:15', 'vm-uuid': '38f6fbf6-3909-49d8-ab29-fb57a1727394'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:22 user nova-compute[75648]: INFO os_vif [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4')
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] No VIF found with MAC fa:16:3e:70:be:15, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updated VIF entry in instance network info cache for port 76b8b8e6-c430-4222-a726-7a45dd82c22b. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updating instance_info_cache with network_info: [{"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2374d336-a09c-480c-8be7-f19f2e475258 req-ed3df909-ac39-4abe-97fa-913f2da01229 service nova] Releasing lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-4e72a6f2-71c2-4117-b8b5-c013fae721f0 req-7bb32587-9fcb-44bb-b700-0b769124ad06 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4e72a6f2-71c2-4117-b8b5-c013fae721f0 req-7bb32587-9fcb-44bb-b700-0b769124ad06 service nova] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4e72a6f2-71c2-4117-b8b5-c013fae721f0 req-7bb32587-9fcb-44bb-b700-0b769124ad06 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.013s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4e72a6f2-71c2-4117-b8b5-c013fae721f0 req-7bb32587-9fcb-44bb-b700-0b769124ad06 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-4e72a6f2-71c2-4117-b8b5-c013fae721f0 req-7bb32587-9fcb-44bb-b700-0b769124ad06 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] No waiting events found dispatching network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:25 user nova-compute[75648]: WARNING nova.compute.manager [req-4e72a6f2-71c2-4117-b8b5-c013fae721f0 req-7bb32587-9fcb-44bb-b700-0b769124ad06 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received unexpected event network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b for instance with vm_state building and task_state spawning.
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] No waiting events found dispatching network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:27 user nova-compute[75648]: WARNING nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received unexpected event network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b for instance with vm_state building and task_state spawning.
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] No waiting events found dispatching network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:27 user nova-compute[75648]: WARNING nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received unexpected event network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 for instance with vm_state building and task_state spawning.
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] No waiting events found dispatching network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:27 user nova-compute[75648]: WARNING nova.compute.manager [req-c050afb6-eeee-4934-9073-a2946ef4255c req-272121f3-d492-4c25-97d6-4b31a243f283 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received unexpected event network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 for instance with vm_state building and task_state spawning.
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.011s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:39:27 user nova-compute[75648]: INFO nova.compute.claims [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Claim successful on node user
Nov 15 05:39:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-628af9c4-70ec-4614-92f3-3a560c369541 req-7424de1c-b054-4d1f-bcae-123c11469fb5 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-628af9c4-70ec-4614-92f3-3a560c369541 req-7424de1c-b054-4d1f-bcae-123c11469fb5 service nova] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-628af9c4-70ec-4614-92f3-3a560c369541 req-7424de1c-b054-4d1f-bcae-123c11469fb5 service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-628af9c4-70ec-4614-92f3-3a560c369541 req-7424de1c-b054-4d1f-bcae-123c11469fb5 service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-628af9c4-70ec-4614-92f3-3a560c369541 req-7424de1c-b054-4d1f-bcae-123c11469fb5 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] No waiting events found dispatching network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:28 user nova-compute[75648]: WARNING nova.compute.manager [req-628af9c4-70ec-4614-92f3-3a560c369541 req-7424de1c-b054-4d1f-bcae-123c11469fb5 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received unexpected event network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 for instance with vm_state active and task_state None.
Nov 15 05:39:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.057s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:39:28 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:39:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Creating image(s)
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "/opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "/opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "/opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.policy [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d790a8fa34148109acfe00813c864b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd9d7e1ca12a349478fbf6722059ec859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Instance spawned successfully.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Instance spawned successfully.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Took 15.65 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Instance spawned successfully.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Took 13.90 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.217s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.compute.manager [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Took 17.28 seconds to build instance.
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Took 10.96 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:29 user nova-compute[75648]: INFO nova.compute.manager [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Took 17.07 seconds to build instance.
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-adf6a80b-deb7-4e2a-9dea-7eff6a05db90 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.590s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk 1073741824" returned: 0 in 0.152s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8ccc694-306a-4fb7-a95d-dbb7d4a9ef5d tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.410s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:39:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:30 user nova-compute[75648]: INFO nova.compute.manager [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Took 12.32 seconds to build instance.
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0cf0c53-87d3-434c-b8ad-7b7537fa7407 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.531s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Cannot resize image /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Ensure instance console log exists: /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-7d69ca9e-5497-4e5a-a08f-6784d277a7fa req-019fac9d-b83c-4b39-bb8b-117e45692a8c service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7d69ca9e-5497-4e5a-a08f-6784d277a7fa req-019fac9d-b83c-4b39-bb8b-117e45692a8c service nova] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7d69ca9e-5497-4e5a-a08f-6784d277a7fa req-019fac9d-b83c-4b39-bb8b-117e45692a8c service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7d69ca9e-5497-4e5a-a08f-6784d277a7fa req-019fac9d-b83c-4b39-bb8b-117e45692a8c service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-7d69ca9e-5497-4e5a-a08f-6784d277a7fa req-019fac9d-b83c-4b39-bb8b-117e45692a8c service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] No waiting events found dispatching network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:30 user nova-compute[75648]: WARNING nova.compute.manager [req-7d69ca9e-5497-4e5a-a08f-6784d277a7fa req-019fac9d-b83c-4b39-bb8b-117e45692a8c service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received unexpected event network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 for instance with vm_state active and task_state None.
Nov 15 05:39:31 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Successfully created port: 4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Successfully updated port: 4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquired lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:39:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-changed-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Refreshing instance network info cache due to event network-changed-4410ca77-8cc0-4991-bd20-063ee83e9ee7. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] Acquiring lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updating instance_info_cache with network_info: [{"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Releasing lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Instance network_info: |[{"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] Acquired lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Refreshing network info cache for port 4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Start _get_guest_xml network_info=[{"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:39:33 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:33 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1311464084',display_name='tempest-VolumesAssistedSnapshotsTest-server-1311464084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1311464084',id=10,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWhNrwtM49G01/LGGUeWSOfnIhrBWJm9KPIvQkOz4J6aoQEYkmgRXwigC5IOwXb+9Oa/sq3IyvtsJVIzlGVKfgEbxdZ5SAR3NbYy1cR0yAzsxkGACq8YMF/yUhLVP2XUw==',key_name='tempest-keypair-1141219711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d7e1ca12a349478fbf6722059ec859',ramdisk_id='',reservation_id='r-rmdb9ssb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2077174352',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2077174352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d790a8fa34148109acfe00813c864b9',uuid=5a5c0387-b0a7-4f9a-9f6a-38aee76930ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Converting VIF {"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:33 user nova-compute[75648]:   <uuid>5a5c0387-b0a7-4f9a-9f6a-38aee76930ea</uuid>
Nov 15 05:39:33 user nova-compute[75648]:   <name>instance-0000000a</name>
Nov 15 05:39:33 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:33 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:33 user nova-compute[75648]:   <metadata>
Nov 15 05:39:33 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:33 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:33 user nova-compute[75648]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1311464084</nova:name>
Nov 15 05:39:33 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:39:33</nova:creationTime>
Nov 15 05:39:33 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:33 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:33 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:33 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:user uuid="8d790a8fa34148109acfe00813c864b9">tempest-VolumesAssistedSnapshotsTest-2077174352-project-member</nova:user>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:project uuid="d9d7e1ca12a349478fbf6722059ec859">tempest-VolumesAssistedSnapshotsTest-2077174352</nova:project>
Nov 15 05:39:33 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:33 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:39:33 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:33 user nova-compute[75648]:         <nova:port uuid="4410ca77-8cc0-4991-bd20-063ee83e9ee7">
Nov 15 05:39:33 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 05:39:33 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:33 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:33 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:33 user nova-compute[75648]:   </metadata>
Nov 15 05:39:33 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:33 user nova-compute[75648]:     <system>
Nov 15 05:39:33 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:33 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:33 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:33 user nova-compute[75648]:       <entry name="serial">5a5c0387-b0a7-4f9a-9f6a-38aee76930ea</entry>
Nov 15 05:39:33 user nova-compute[75648]:       <entry name="uuid">5a5c0387-b0a7-4f9a-9f6a-38aee76930ea</entry>
Nov 15 05:39:33 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:33 user nova-compute[75648]:     </system>
Nov 15 05:39:33 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:33 user nova-compute[75648]:   <os>
Nov 15 05:39:33 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:33 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:33 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:33 user nova-compute[75648]:   </os>
Nov 15 05:39:33 user nova-compute[75648]:   <features>
Nov 15 05:39:33 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:33 user nova-compute[75648]:     <apic/>
Nov 15 05:39:33 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:33 user nova-compute[75648]:   </features>
Nov 15 05:39:33 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:33 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:33 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:33 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:33 user nova-compute[75648]:   </clock>
Nov 15 05:39:33 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:33 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:33 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:33 user nova-compute[75648]:   </cpu>
Nov 15 05:39:33 user nova-compute[75648]:   <devices>
Nov 15 05:39:33 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:33 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:33 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk"/>
Nov 15 05:39:33 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:39:33 user nova-compute[75648]:     </disk>
Nov 15 05:39:33 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:33 user nova-compute[75648]:       <mac address="fa:16:3e:d1:2a:2b"/>
Nov 15 05:39:33 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:33 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:33 user nova-compute[75648]:       <target dev="tap4410ca77-8c"/>
Nov 15 05:39:33 user nova-compute[75648]:     </interface>
Nov 15 05:39:33 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:33 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/console.log" append="off"/>
Nov 15 05:39:33 user nova-compute[75648]:     </serial>
Nov 15 05:39:33 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:33 user nova-compute[75648]:     <video>
Nov 15 05:39:33 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:33 user nova-compute[75648]:     </video>
Nov 15 05:39:33 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:33 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:33 user nova-compute[75648]:     </rng>
Nov 15 05:39:33 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:33 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:33 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:33 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:33 user nova-compute[75648]:   </devices>
Nov 15 05:39:33 user nova-compute[75648]: </domain>
Nov 15 05:39:33 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1311464084',display_name='tempest-VolumesAssistedSnapshotsTest-server-1311464084',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1311464084',id=10,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWhNrwtM49G01/LGGUeWSOfnIhrBWJm9KPIvQkOz4J6aoQEYkmgRXwigC5IOwXb+9Oa/sq3IyvtsJVIzlGVKfgEbxdZ5SAR3NbYy1cR0yAzsxkGACq8YMF/yUhLVP2XUw==',key_name='tempest-keypair-1141219711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d9d7e1ca12a349478fbf6722059ec859',ramdisk_id='',reservation_id='r-rmdb9ssb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2077174352',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2077174352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d790a8fa34148109acfe00813c864b9',uuid=5a5c0387-b0a7-4f9a-9f6a-38aee76930ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Converting VIF {"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG os_vif [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daba8402-5879-5cf7-b8ff-c20869974386', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4410ca77-8c, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4410ca77-8c, col_values=(('qos', UUID('4128c4fa-4487-4870-b308-bc8a3010c693')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4410ca77-8c, col_values=(('external_ids', {'iface-id': '4410ca77-8cc0-4991-bd20-063ee83e9ee7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:2a:2b', 'vm-uuid': '5a5c0387-b0a7-4f9a-9f6a-38aee76930ea'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:33 user nova-compute[75648]: INFO os_vif [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c')
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] No VIF found with MAC fa:16:3e:d1:2a:2b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updated VIF entry in instance network info cache for port 4410ca77-8cc0-4991-bd20-063ee83e9ee7. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updating instance_info_cache with network_info: [{"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dfb2a64f-0c4f-4f96-b1af-25f2cebb63aa req-d426c702-3b9d-4379-8307-c6d2fee7aec6 service nova] Releasing lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-662fda79-2567-4927-990b-c1d4169b6383 req-72dbfcda-f10f-4236-a5ca-89475cb80ee2 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-662fda79-2567-4927-990b-c1d4169b6383 req-72dbfcda-f10f-4236-a5ca-89475cb80ee2 service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-662fda79-2567-4927-990b-c1d4169b6383 req-72dbfcda-f10f-4236-a5ca-89475cb80ee2 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-662fda79-2567-4927-990b-c1d4169b6383 req-72dbfcda-f10f-4236-a5ca-89475cb80ee2 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-662fda79-2567-4927-990b-c1d4169b6383 req-72dbfcda-f10f-4236-a5ca-89475cb80ee2 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:36 user nova-compute[75648]: WARNING nova.compute.manager [req-662fda79-2567-4927-990b-c1d4169b6383 req-72dbfcda-f10f-4236-a5ca-89475cb80ee2 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state active and task_state None.
Nov 15 05:39:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-29aa3ae5-16d8-4fc2-b694-3254ecc2b4f7 req-a4858e02-7de0-4c54-a66b-f3e89fb0e19f service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29aa3ae5-16d8-4fc2-b694-3254ecc2b4f7 req-a4858e02-7de0-4c54-a66b-f3e89fb0e19f service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29aa3ae5-16d8-4fc2-b694-3254ecc2b4f7 req-a4858e02-7de0-4c54-a66b-f3e89fb0e19f service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29aa3ae5-16d8-4fc2-b694-3254ecc2b4f7 req-a4858e02-7de0-4c54-a66b-f3e89fb0e19f service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-29aa3ae5-16d8-4fc2-b694-3254ecc2b4f7 req-a4858e02-7de0-4c54-a66b-f3e89fb0e19f service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:36 user nova-compute[75648]: WARNING nova.compute.manager [req-29aa3ae5-16d8-4fc2-b694-3254ecc2b4f7 req-a4858e02-7de0-4c54-a66b-f3e89fb0e19f service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state None.
Nov 15 05:39:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Instance spawned successfully.
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:37 user nova-compute[75648]: INFO nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Took 8.72 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:37 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:38 user nova-compute[75648]: INFO nova.compute.manager [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Took 10.54 seconds to build instance.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d2c79fc-9404-4ff8-a297-6f6856d8136c tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.770s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] No waiting events found dispatching network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received unexpected event network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] No waiting events found dispatching network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received unexpected event network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] No waiting events found dispatching network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received unexpected event network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] No waiting events found dispatching network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-2985c1dc-1543-4be8-ae13-6b92fa960926 req-5598ded2-ee13-4ecb-93ea-250c219ab6df service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received unexpected event network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state active and task_state None.
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] No waiting events found dispatching network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:38 user nova-compute[75648]: WARNING nova.compute.manager [req-c35e03ad-6f87-4e96-ba25-5ee29d9eba68 req-c25240c0-cdf1-4505-ab50-d33beaee6725 service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received unexpected event network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 for instance with vm_state active and task_state None.
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] No waiting events found dispatching network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:41 user nova-compute[75648]: WARNING nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received unexpected event network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 for instance with vm_state active and task_state None.
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:41 user nova-compute[75648]: WARNING nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state active and task_state None.
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:41 user nova-compute[75648]: WARNING nova.compute.manager [req-c7aad070-f554-426a-866b-0def1ce0778d req-3ac94529-e5d8-4402-b210-ce19fdeda0c9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state active and task_state None.
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:39:45 user nova-compute[75648]: INFO nova.compute.claims [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Claim successful on node user
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:39:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.policy [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ae7fdd74e664596ab1a323e9c9347a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b50966fa1c4fd78b0a555cb3afffee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:39:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Creating image(s)
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "/opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "/opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk 1073741824" returned: 0 in 0.052s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Successfully created port: dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Cannot resize image /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Ensure instance console log exists: /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Successfully updated port: dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquired lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-changed-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Refreshing instance network info cache due to event network-changed-dbb125a4-be50-4777-baec-60fe0ec9e534. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] Acquiring lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating instance_info_cache with network_info: [{"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Releasing lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Instance network_info: |[{"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] Acquired lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.neutron [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Refreshing network info cache for port dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Start _get_guest_xml network_info=[{"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:39:48 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:48 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1758105222',display_name='tempest-TestStampPattern-server-1758105222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1758105222',id=11,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoS16Y3HpfD0rY8HR4haBL7SzdPRoe0noXJF12ixXptNi3aAgE2AkkZArlpCa0FKKxvIhR6Hm0dXnO+kB90zMOmyhlZh1WRdqxONLK1loWH9Oj0yK5VWXCMdaCm6WMDVQ==',key_name='tempest-TestStampPattern-833870012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b50966fa1c4fd78b0a555cb3afffee',ramdisk_id='',reservation_id='r-xtymi1dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-591482588',owner_user_name='tempest-TestStampPattern-591482588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:47Z,user_data=None,user_id='4ae7fdd74e664596ab1a323e9c9347a5',uuid=1c801b45-ec7e-4f10-9443-6ab54528ab70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converting VIF {"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:39:48 user nova-compute[75648]:   <uuid>1c801b45-ec7e-4f10-9443-6ab54528ab70</uuid>
Nov 15 05:39:48 user nova-compute[75648]:   <name>instance-0000000b</name>
Nov 15 05:39:48 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:39:48 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:39:48 user nova-compute[75648]:   <metadata>
Nov 15 05:39:48 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:39:48 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:39:48 user nova-compute[75648]:       <nova:name>tempest-TestStampPattern-server-1758105222</nova:name>
Nov 15 05:39:48 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:39:48</nova:creationTime>
Nov 15 05:39:48 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:39:48 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:39:48 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:39:48 user nova-compute[75648]:       <nova:owner>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:user uuid="4ae7fdd74e664596ab1a323e9c9347a5">tempest-TestStampPattern-591482588-project-member</nova:user>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:project uuid="79b50966fa1c4fd78b0a555cb3afffee">tempest-TestStampPattern-591482588</nova:project>
Nov 15 05:39:48 user nova-compute[75648]:       </nova:owner>
Nov 15 05:39:48 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:39:48 user nova-compute[75648]:       <nova:ports>
Nov 15 05:39:48 user nova-compute[75648]:         <nova:port uuid="dbb125a4-be50-4777-baec-60fe0ec9e534">
Nov 15 05:39:48 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 05:39:48 user nova-compute[75648]:         </nova:port>
Nov 15 05:39:48 user nova-compute[75648]:       </nova:ports>
Nov 15 05:39:48 user nova-compute[75648]:     </nova:instance>
Nov 15 05:39:48 user nova-compute[75648]:   </metadata>
Nov 15 05:39:48 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:39:48 user nova-compute[75648]:     <system>
Nov 15 05:39:48 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:39:48 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:39:48 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:39:48 user nova-compute[75648]:       <entry name="serial">1c801b45-ec7e-4f10-9443-6ab54528ab70</entry>
Nov 15 05:39:48 user nova-compute[75648]:       <entry name="uuid">1c801b45-ec7e-4f10-9443-6ab54528ab70</entry>
Nov 15 05:39:48 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:39:48 user nova-compute[75648]:     </system>
Nov 15 05:39:48 user nova-compute[75648]:   </sysinfo>
Nov 15 05:39:48 user nova-compute[75648]:   <os>
Nov 15 05:39:48 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:39:48 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:39:48 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:39:48 user nova-compute[75648]:   </os>
Nov 15 05:39:48 user nova-compute[75648]:   <features>
Nov 15 05:39:48 user nova-compute[75648]:     <acpi/>
Nov 15 05:39:48 user nova-compute[75648]:     <apic/>
Nov 15 05:39:48 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:39:48 user nova-compute[75648]:   </features>
Nov 15 05:39:48 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:39:48 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:39:48 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:39:48 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:39:48 user nova-compute[75648]:   </clock>
Nov 15 05:39:48 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:39:48 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:39:48 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:39:48 user nova-compute[75648]:   </cpu>
Nov 15 05:39:48 user nova-compute[75648]:   <devices>
Nov 15 05:39:48 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:39:48 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:39:48 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk"/>
Nov 15 05:39:48 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:39:48 user nova-compute[75648]:     </disk>
Nov 15 05:39:48 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:39:48 user nova-compute[75648]:       <mac address="fa:16:3e:36:c5:e6"/>
Nov 15 05:39:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:48 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:39:48 user nova-compute[75648]:       <target dev="tapdbb125a4-be"/>
Nov 15 05:39:48 user nova-compute[75648]:     </interface>
Nov 15 05:39:48 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:39:48 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/console.log" append="off"/>
Nov 15 05:39:48 user nova-compute[75648]:     </serial>
Nov 15 05:39:48 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:39:48 user nova-compute[75648]:     <video>
Nov 15 05:39:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:39:48 user nova-compute[75648]:     </video>
Nov 15 05:39:48 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:39:48 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:39:48 user nova-compute[75648]:     </rng>
Nov 15 05:39:48 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:39:48 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:39:48 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:39:48 user nova-compute[75648]:     </memballoon>
Nov 15 05:39:48 user nova-compute[75648]:   </devices>
Nov 15 05:39:48 user nova-compute[75648]: </domain>
Nov 15 05:39:48 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1758105222',display_name='tempest-TestStampPattern-server-1758105222',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1758105222',id=11,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoS16Y3HpfD0rY8HR4haBL7SzdPRoe0noXJF12ixXptNi3aAgE2AkkZArlpCa0FKKxvIhR6Hm0dXnO+kB90zMOmyhlZh1WRdqxONLK1loWH9Oj0yK5VWXCMdaCm6WMDVQ==',key_name='tempest-TestStampPattern-833870012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b50966fa1c4fd78b0a555cb3afffee',ramdisk_id='',reservation_id='r-xtymi1dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-591482588',owner_user_name='tempest-TestStampPattern-591482588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:47Z,user_data=None,user_id='4ae7fdd74e664596ab1a323e9c9347a5',uuid=1c801b45-ec7e-4f10-9443-6ab54528ab70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converting VIF {"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG os_vif [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f332419-a2cd-5464-b712-668cf763313e', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbb125a4-be, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbb125a4-be, col_values=(('qos', UUID('e6342d1e-3f1e-4a63-a879-8153e627d3be')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbb125a4-be, col_values=(('external_ids', {'iface-id': 'dbb125a4-be50-4777-baec-60fe0ec9e534', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:c5:e6', 'vm-uuid': '1c801b45-ec7e-4f10-9443-6ab54528ab70'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:48 user nova-compute[75648]: INFO os_vif [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be')
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No VIF found with MAC fa:16:3e:36:c5:e6, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:39:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-a9bd9ba0-84f4-466b-8a46-516db8d5e3d0 req-70fa29dc-4508-4eeb-a65d-e1223a284c49 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a9bd9ba0-84f4-466b-8a46-516db8d5e3d0 req-70fa29dc-4508-4eeb-a65d-e1223a284c49 service nova] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a9bd9ba0-84f4-466b-8a46-516db8d5e3d0 req-70fa29dc-4508-4eeb-a65d-e1223a284c49 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a9bd9ba0-84f4-466b-8a46-516db8d5e3d0 req-70fa29dc-4508-4eeb-a65d-e1223a284c49 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-a9bd9ba0-84f4-466b-8a46-516db8d5e3d0 req-70fa29dc-4508-4eeb-a65d-e1223a284c49 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] No waiting events found dispatching network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:52 user nova-compute[75648]: WARNING nova.compute.manager [req-a9bd9ba0-84f4-466b-8a46-516db8d5e3d0 req-70fa29dc-4508-4eeb-a65d-e1223a284c49 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received unexpected event network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 for instance with vm_state building and task_state spawning.
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-65f0da8d-6cd1-4217-8e21-83b37133a50b req-0b9af241-2ed8-4be5-9302-8d28a72bbb58 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-65f0da8d-6cd1-4217-8e21-83b37133a50b req-0b9af241-2ed8-4be5-9302-8d28a72bbb58 service nova] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-65f0da8d-6cd1-4217-8e21-83b37133a50b req-0b9af241-2ed8-4be5-9302-8d28a72bbb58 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-65f0da8d-6cd1-4217-8e21-83b37133a50b req-0b9af241-2ed8-4be5-9302-8d28a72bbb58 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-65f0da8d-6cd1-4217-8e21-83b37133a50b req-0b9af241-2ed8-4be5-9302-8d28a72bbb58 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] No waiting events found dispatching network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:39:52 user nova-compute[75648]: WARNING nova.compute.manager [req-65f0da8d-6cd1-4217-8e21-83b37133a50b req-0b9af241-2ed8-4be5-9302-8d28a72bbb58 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received unexpected event network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 for instance with vm_state building and task_state spawning.
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:52 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:52 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7249MB free_disk=25.714496612548828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:39:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Instance spawned successfully.
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:39:52 user nova-compute[75648]: INFO nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Took 6.14 seconds to spawn the instance on the hypervisor.
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:39:52 user nova-compute[75648]: INFO nova.compute.manager [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Took 7.18 seconds to build instance.
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updated VIF entry in instance network info cache for port dbb125a4-be50-4777-baec-60fe0ec9e534. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:39:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating instance_info_cache with network_info: [{"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ce9bd3a1-37cb-408c-9a3f-33bffd25f4aa tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.289s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f544139f-283b-4c7a-bbad-1f63703302f4 req-ecff2db6-5294-4b39-b5a7-ef382f2879cf service nova] Releasing lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 4d78e23e-b1d9-4395-9885-c515e558f673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5d79d7ce-24cf-4a16-8e0f-769417a4bece actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance bd28591c-ff83-40f9-8298-9fab5de1dcbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.028s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.619s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:39:53 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:39:53 user nova-compute[75648]: INFO nova.compute.claims [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Claim successful on node user
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:39:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:39:54 user nova-compute[75648]: INFO nova.virt.block_device [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Booting with volume 4707ad88-91f2-4f67-8b89-dc51ffa100f3 at /dev/vda
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.policy [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1026e52571e4bbbb7416ccab6256bd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d553191c88e43b6a3c1f19f88b72913', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:39:54 user nova-compute[75648]: INFO oslo.privsep.daemon [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp03kqy80w/privsep.sock']
Nov 15 05:39:54 user sudo[87012]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp03kqy80w/privsep.sock
Nov 15 05:39:54 user sudo[87012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 15 05:39:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Skipping network cache update for instance because it is Building. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:39:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully created port: 7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:39:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully created port: 74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:56 user sudo[87012]: pam_unix(sudo:session): session closed for user root
Nov 15 05:39:56 user nova-compute[75648]: INFO oslo.privsep.daemon [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Spawned new privsep daemon via rootwrap
Nov 15 05:39:56 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 15 05:39:56 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 15 05:39:56 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 15 05:39:56 user nova-compute[75648]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87015
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b835113-7a25-4fdf-87a1-092e6634da58]: (2,) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully created port: a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30a9ec8-b211-411b-86c8-29decf5d9d18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:39:56 user nova-compute[75648]: WARNING os_brick.initiator.connectors.nvmeof [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89bd0fb-286f-45fd-9bb9-fa0129ae27d2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3510c99-adc3-4ede-9e01-283b01649b55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa57739-08c7-4518-adb2-256ff0b393eb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:39:56 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:39:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c50a82-1a95-4fe6-9f09-e2dfc7e5d607]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== get_connector_properties: return (1792ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating existing volume attachment record: 023fef0f-74b9-4d49-8d86-09b5c0d6c815 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:39:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully created port: 623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully created port: 4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: 7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-7b20824a-3150-43fc-8188-4ebbc0e11d4c. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port 7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.network.neutron [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3dae902-18c0-4c29-817a-9ce501ce1be5 req-2a7def95-455c-4ea5-ab81-9b95d56f2329 service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:39:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:39:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-ab297d47-f95b-4ed9-b0c5-50b11c98db33. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: 74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-fa3f16d9-6690-47ee-8f1c-ad5089782975. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:00 user nova-compute[75648]: DEBUG nova.network.neutron [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG nova.network.neutron [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-20af0e6d-6232-4700-856c-5dfdf5630e50 req-6c65b5dd-4546-4547-a03b-db6de14339ee service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:40:01 user nova-compute[75648]: INFO nova.virt.block_device [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Booting with volume cbf61be1-6861-4cb2-b8c7-d0469ba59249 at /dev/vdb
Nov 15 05:40:01 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[799bdf6e-c381-4b84-8d95-a2682b80db29]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[98100777-350f-4344-a19d-e739c49312e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6eb9b5-8a1f-4d33-bf6b-27034ada9ae9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[010fc78e-4d00-4a0c-9833-6f22ada51c1c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:01 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:40:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fdd1a9-6b51-49c7-9baa-d2080c499230]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating existing volume attachment record: d52f2dd0-bf74-4fb8-bfb0-eadca06b4d28 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:40:01 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: 623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-74ff529b-38db-4002-b259-f8bcf989ba68. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port 74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Successfully updated port: 4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-a51ac001-f74d-46c5-b283-ff918f27ed1b. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-623b99f1-a342-4767-8189-2e883a779a3f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port 623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30050090-7ad5-47e5-a47f-e8dc4d0bd6af req-23447e67-1fd6-46e8-8f6a-09b10882a8e8 service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-4fb6a740-625e-4720-9404-e97f8b46e5fd. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance network_info: |[{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:40:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port 4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG nova.network.neutron [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updated VIF entry in instance network info cache for port 4fb6a740-625e-4720-9404-e97f8b46e5fd. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG nova.network.neutron [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a0004246-e7af-4854-8bdb-03801a71197e req-42dde43e-aadf-4d9a-9c68-b5f0566512a0 service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:06 user nova-compute[75648]: INFO nova.virt.block_device [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Booting with volume a8020953-48b2-45fd-a09f-d491403d8832 at /dev/vdc
Nov 15 05:40:06 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc612cb-e3d5-4e94-9659-486afcc8a5b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cfaa6e-590c-4de6-9113-b3f2448a4ecf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[520d2f59-1b90-4b2f-a795-b50cfad8bfb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82a4c34-b8c0-4362-817c-c42f329551cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:06 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:40:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[951f0a38-5ce9-45dd-8887-e97464fba9c5]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:06 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating existing volume attachment record: d07831ad-be3b-47ed-8c73-20007eeef9ec {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:40:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:40:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Creating image(s)
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Ensure instance console log exists: /opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Start _get_guest_xml network_info=[{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '023fef0f-74b9-4d49-8d86-09b5c0d6c815', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVtkwXrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1', 'attached_at': '', 'detached_at': '', 'volume_id': '4707ad88-91f2-4f67-8b89-dc51ffa100f3', 'serial': '4707ad88-91f2-4f67-8b89-dc51ffa100f3'}, 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'd52f2dd0-bf74-4fb8-bfb0-eadca06b4d28', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eViNUwyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'cbf61be1-6861-4cb2-b8c7-d0469ba59249', 'serial': 'cbf61be1-6861-4cb2-b8c7-d0469ba59249'}, 'delete_on_termination': False, 'volume_type': None}, {'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'd07831ad-be3b-47ed-8c73-20007eeef9ec', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnNeoXAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8020953-48b2-45fd-a09f-d491403d8832', 'serial': 'a8020953-48b2-45fd-a09f-d491403d8832'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:40:12 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:12 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connector [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Factory for ISCSI on None {{(pid=75648) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVtkwXrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:12 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[135801d4-5513-49c2-a37c-dfa04e2bf651]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:40:12 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6a871-8195-40b3-bcea-c57dbcaa8daa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3] added
Nov 15 05:40:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cc7217-b36d-4170-b1f8-c1da8be6641f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a1cb6b-104c-4d4e-8231-e306b0d0fb33]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVtkwXrZ {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hVtkwXrZ" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[870b9769-3080-4f0d-9297-a22af3755f30]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hVtkwXrZ'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478877b-378d-4609-814a-f5a951570f36]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[66950d50-131d-4d15-b14f-ea45c64a7620]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 05:40:12 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 05:40:12 user nova-compute[75648]:  {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 05:40:12 user nova-compute[75648]: 
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfbd271-b95c-4807-8dad-e4143d8e1452]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260]
Nov 15 05:40:12 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260] successful.
Nov 15 05:40:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d919719a-9566-48bf-a046-7cb9059f3ad1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[47286360-bf49-4fbe-83c6-b7a30802d615]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0351cd65-5e5e-4c35-92f3-3b51d6d6a6c7]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:40:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVtkwXrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '23235303465633238', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235303465633238', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eViNUwyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:13 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:13 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:13 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ca7cc9-344b-403f-8fe6-0fda9b9a55b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:40:13 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e45e09c-cdd5-44fd-b60e-6ad68a5230f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249] added
Nov 15 05:40:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b2ae01-6d2f-473b-a42e-e70981dcc2c6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7abcfe96-5d8b-4050-b30d-1d0e4d501f7c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eViNUwyp {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eViNUwyp" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de1c0e1-0410-4199-ac57-b44cf9e8c715]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eViNUwyp'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85396a2-5b80-40d5-8e25-f72a5f794ad6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d01aef6-8dfc-426c-82d2-40a224722052]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8671ceb-7eb1-4615-aa8d-41257ab7eac6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260]
Nov 15 05:40:13 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260] successful.
Nov 15 05:40:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[832165c5-a931-4649-8f2c-b2d0aa41a9f1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fb26c8-2a66-436e-99cc-66c230f2a7f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:13 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:13 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff70a02-c612-4ec3-98f9-8f6a07e1fb3b]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:13 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eViNUwyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23130353031393039', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353031393039', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnNeoXAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:14 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55ae9d-ca77-4b58-b898-1983441bf0b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:40:14 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a214c5-d794-474a-9d79-7995a28d15b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832] added
Nov 15 05:40:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[167bb750-4227-4e78-85fb-dbf1bd4a0a0d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8912fb27-5702-4fc1-bda1-3182a73ca52b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnNeoXAV {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tnNeoXAV" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbd7150-7cea-45e8-b6c0-3fc7c2730da2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tnNeoXAV'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1645d510-31c4-4cde-8d77-9f6c3dc540f1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ce29c-5b29-4383-b4d7-6788b28aa0a8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:14 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:14 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19b53fd-8a69-4e0d-9d4b-44e56d02c09a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260]
Nov 15 05:40:15 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260] successful.
Nov 15 05:40:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e05c8a-631a-4760-aaf7-135509565ba1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d93be-5a81-42b6-8939-7f539e28c80a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:15 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:15 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:15 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:15 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[47da4ef2-8b02-43d6-87f3-95c49f33630b]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:40:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnNeoXAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '26132343538396366', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132343538396366', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:40:16 user nova-compute[75648]:   <uuid>9bf56e1c-854a-4d47-8569-c71d2c6cc8c1</uuid>
Nov 15 05:40:16 user nova-compute[75648]:   <name>instance-0000000c</name>
Nov 15 05:40:16 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:40:16 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:40:16 user nova-compute[75648]:   <metadata>
Nov 15 05:40:16 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:40:16 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:40:16 user nova-compute[75648]:       <nova:name>tempest-device-tagging-server-1029037045</nova:name>
Nov 15 05:40:16 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:40:12</nova:creationTime>
Nov 15 05:40:16 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:40:16 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:40:16 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:40:16 user nova-compute[75648]:       <nova:owner>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:user uuid="e1026e52571e4bbbb7416ccab6256bd4">tempest-TaggedBootDevicesTest_v242-1891485400-project-member</nova:user>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:project uuid="1d553191c88e43b6a3c1f19f88b72913">tempest-TaggedBootDevicesTest_v242-1891485400</nova:project>
Nov 15 05:40:16 user nova-compute[75648]:       </nova:owner>
Nov 15 05:40:16 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:40:16 user nova-compute[75648]:       <nova:ports>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="7b20824a-3150-43fc-8188-4ebbc0e11d4c">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="ab297d47-f95b-4ed9-b0c5-50b11c98db33">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.1.1.137" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="fa3f16d9-6690-47ee-8f1c-ad5089782975">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.1.1.186" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="74ff529b-38db-4002-b259-f8bcf989ba68">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.1.1.39" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="a51ac001-f74d-46c5-b283-ff918f27ed1b">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.1.1.162" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="623b99f1-a342-4767-8189-2e883a779a3f">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:         <nova:port uuid="4fb6a740-625e-4720-9404-e97f8b46e5fd">
Nov 15 05:40:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 15 05:40:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:16 user nova-compute[75648]:       </nova:ports>
Nov 15 05:40:16 user nova-compute[75648]:     </nova:instance>
Nov 15 05:40:16 user nova-compute[75648]:   </metadata>
Nov 15 05:40:16 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:40:16 user nova-compute[75648]:     <system>
Nov 15 05:40:16 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:40:16 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:40:16 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:40:16 user nova-compute[75648]:       <entry name="serial">9bf56e1c-854a-4d47-8569-c71d2c6cc8c1</entry>
Nov 15 05:40:16 user nova-compute[75648]:       <entry name="uuid">9bf56e1c-854a-4d47-8569-c71d2c6cc8c1</entry>
Nov 15 05:40:16 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:40:16 user nova-compute[75648]:     </system>
Nov 15 05:40:16 user nova-compute[75648]:   </sysinfo>
Nov 15 05:40:16 user nova-compute[75648]:   <os>
Nov 15 05:40:16 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:40:16 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:40:16 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:40:16 user nova-compute[75648]:   </os>
Nov 15 05:40:16 user nova-compute[75648]:   <features>
Nov 15 05:40:16 user nova-compute[75648]:     <acpi/>
Nov 15 05:40:16 user nova-compute[75648]:     <apic/>
Nov 15 05:40:16 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:40:16 user nova-compute[75648]:   </features>
Nov 15 05:40:16 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:40:16 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:40:16 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:40:16 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:40:16 user nova-compute[75648]:   </clock>
Nov 15 05:40:16 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:40:16 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:40:16 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:40:16 user nova-compute[75648]:   </cpu>
Nov 15 05:40:16 user nova-compute[75648]:   <devices>
Nov 15 05:40:16 user nova-compute[75648]:     <disk type="file" device="cdrom">
Nov 15 05:40:16 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 05:40:16 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1/disk.config"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="hda" bus="ide"/>
Nov 15 05:40:16 user nova-compute[75648]:     </disk>
Nov 15 05:40:16 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:40:16 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:40:16 user nova-compute[75648]:       <source dev="/dev/sdb"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <serial>4707ad88-91f2-4f67-8b89-dc51ffa100f3</serial>
Nov 15 05:40:16 user nova-compute[75648]:     </disk>
Nov 15 05:40:16 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:40:16 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:40:16 user nova-compute[75648]:       <source dev="/dev/sdc"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <serial>cbf61be1-6861-4cb2-b8c7-d0469ba59249</serial>
Nov 15 05:40:16 user nova-compute[75648]:     </disk>
Nov 15 05:40:16 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:40:16 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:40:16 user nova-compute[75648]:       <source dev="/dev/sdd"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="vdc" bus="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <serial>a8020953-48b2-45fd-a09f-d491403d8832</serial>
Nov 15 05:40:16 user nova-compute[75648]:     </disk>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:6a:74:42"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tap7b20824a-31"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:01:46:61"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tapab297d47-f9"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:43:ab:35"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tapfa3f16d9-66"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:a0:10:ee"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tap74ff529b-38"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:ac:09:20"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tapa51ac001-f7"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:29:36:66"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tap623b99f1-a3"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:16 user nova-compute[75648]:       <mac address="fa:16:3e:e8:92:18"/>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:16 user nova-compute[75648]:       <target dev="tap4fb6a740-62"/>
Nov 15 05:40:16 user nova-compute[75648]:     </interface>
Nov 15 05:40:16 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:40:16 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1/console.log" append="off"/>
Nov 15 05:40:16 user nova-compute[75648]:     </serial>
Nov 15 05:40:16 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:40:16 user nova-compute[75648]:     <video>
Nov 15 05:40:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:16 user nova-compute[75648]:     </video>
Nov 15 05:40:16 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:40:16 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:40:16 user nova-compute[75648]:     </rng>
Nov 15 05:40:16 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:40:16 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:40:16 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:40:16 user nova-compute[75648]:     </memballoon>
Nov 15 05:40:16 user nova-compute[75648]:   </devices>
Nov 15 05:40:16 user nova-compute[75648]: </domain>
Nov 15 05:40:16 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '836c83a8-6d99-53ed-b54e-977f35805980', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b20824a-31, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b20824a-31, col_values=(('qos', UUID('364244b8-6fe0-4b34-a9c3-2f1bd527da27')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b20824a-31, col_values=(('external_ids', {'iface-id': '7b20824a-3150-43fc-8188-4ebbc0e11d4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:74:42', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46884af4-8c1e-5d1d-81e5-f4447d5dfcd8', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapab297d47-f9, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapab297d47-f9, col_values=(('qos', UUID('a3c18b83-5ef4-4e9c-86fd-48351428ad61')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapab297d47-f9, col_values=(('external_ids', {'iface-id': 'ab297d47-f95b-4ed9-b0c5-50b11c98db33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:46:61', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8f2ac3ff-821c-589e-b6df-5ff6b97febcf', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa3f16d9-66, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa3f16d9-66, col_values=(('qos', UUID('f1765b66-b600-46b3-a9f2-1ed9e770ce8d')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa3f16d9-66, col_values=(('external_ids', {'iface-id': 'fa3f16d9-6690-47ee-8f1c-ad5089782975', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:ab:35', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab6801b7-d643-5b15-9dee-a6eb522542de', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74ff529b-38, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74ff529b-38, col_values=(('qos', UUID('3718ebe0-1e3b-4075-9302-833c0d44b507')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74ff529b-38, col_values=(('external_ids', {'iface-id': '74ff529b-38db-4002-b259-f8bcf989ba68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a0:10:ee', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '682ce1c5-ab24-5641-8e85-b93e02740b76', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa51ac001-f7, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa51ac001-f7, col_values=(('qos', UUID('e1d076a9-4818-4e23-bbd9-be9f3642a987')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa51ac001-f7, col_values=(('external_ids', {'iface-id': 'a51ac001-f74d-46c5-b283-ff918f27ed1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:09:20', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76c0263b-0841-5cdc-9df1-3bca2f436f31', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap623b99f1-a3, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap623b99f1-a3, col_values=(('qos', UUID('c0748955-58f5-4645-8961-f6e25aebe44b')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap623b99f1-a3, col_values=(('external_ids', {'iface-id': '623b99f1-a342-4767-8189-2e883a779a3f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:36:66', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be7b483a-b559-575c-acec-86489ac16fbe', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4fb6a740-62, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4fb6a740-62, col_values=(('qos', UUID('45cc3a52-e826-48f6-ae95-7c554b6b6d1e')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4fb6a740-62, col_values=(('external_ids', {'iface-id': '4fb6a740-625e-4720-9404-e97f8b46e5fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:92:18', 'vm-uuid': '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:16 user nova-compute[75648]: INFO os_vif [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62')
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] No BDM found with device name hda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] No VIF found with MAC fa:16:3e:6a:74:42, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:40:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] No VIF found with MAC fa:16:3e:ac:09:20, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:40:16 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Using config drive
Nov 15 05:40:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Creating config drive at /opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1/disk.config
Nov 15 05:40:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8oebxan4 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8oebxan4" returned: 0 in 0.053s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-12b77273-ce51-4405-9534-7639401a6fdd req-9b0196aa-bbef-4c3a-8ee7-2d4c7beab208 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-12b77273-ce51-4405-9534-7639401a6fdd req-9b0196aa-bbef-4c3a-8ee7-2d4c7beab208 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-12b77273-ce51-4405-9534-7639401a6fdd req-9b0196aa-bbef-4c3a-8ee7-2d4c7beab208 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-12b77273-ce51-4405-9534-7639401a6fdd req-9b0196aa-bbef-4c3a-8ee7-2d4c7beab208 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-12b77273-ce51-4405-9534-7639401a6fdd req-9b0196aa-bbef-4c3a-8ee7-2d4c7beab208 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:20 user nova-compute[75648]: WARNING nova.compute.manager [req-12b77273-ce51-4405-9534-7639401a6fdd req-9b0196aa-bbef-4c3a-8ee7-2d4c7beab208 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 for instance with vm_state building and task_state spawning.
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-24c5b233-c813-42e3-b142-b118073d3aa7 req-43dd3fcf-08c5-418b-be7a-27d39e573b28 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-24c5b233-c813-42e3-b142-b118073d3aa7 req-43dd3fcf-08c5-418b-be7a-27d39e573b28 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-24c5b233-c813-42e3-b142-b118073d3aa7 req-43dd3fcf-08c5-418b-be7a-27d39e573b28 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-24c5b233-c813-42e3-b142-b118073d3aa7 req-43dd3fcf-08c5-418b-be7a-27d39e573b28 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-24c5b233-c813-42e3-b142-b118073d3aa7 req-43dd3fcf-08c5-418b-be7a-27d39e573b28 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:22 user nova-compute[75648]: WARNING nova.compute.manager [req-24c5b233-c813-42e3-b142-b118073d3aa7 req-43dd3fcf-08c5-418b-be7a-27d39e573b28 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c for instance with vm_state building and task_state spawning.
Nov 15 05:40:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:22 user nova-compute[75648]: WARNING nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 for instance with vm_state building and task_state spawning.
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:22 user nova-compute[75648]: WARNING nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b for instance with vm_state building and task_state spawning.
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:22 user nova-compute[75648]: WARNING nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b for instance with vm_state building and task_state spawning.
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:22 user nova-compute[75648]: WARNING nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f for instance with vm_state building and task_state spawning.
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:22 user nova-compute[75648]: WARNING nova.compute.manager [req-0ce307cf-3858-4f5f-bc66-bc31c59196d5 req-b44d7fa3-6f25-4bcc-a1c4-9d415538fa03 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f for instance with vm_state building and task_state spawning.
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:40:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance spawned successfully.
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:23 user nova-compute[75648]: INFO nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Took 11.16 seconds to spawn the instance on the hypervisor.
Nov 15 05:40:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:23 user nova-compute[75648]: INFO nova.compute.manager [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Took 30.53 seconds to build instance.
Nov 15 05:40:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8bb74a7-22f7-4b4a-9d58-985e2793d42c tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.662s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:24 user nova-compute[75648]: WARNING nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c for instance with vm_state active and task_state None.
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:24 user nova-compute[75648]: WARNING nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 for instance with vm_state active and task_state None.
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:24 user nova-compute[75648]: WARNING nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 for instance with vm_state active and task_state None.
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:24 user nova-compute[75648]: WARNING nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 for instance with vm_state active and task_state None.
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:24 user nova-compute[75648]: WARNING nova.compute.manager [req-5dcae949-2029-43d8-993d-29fdba62f856 req-117d86a1-b503-40d7-b0ef-b675df2d8e22 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 for instance with vm_state active and task_state None.
Nov 15 05:40:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-2df5f8f7-d751-4ca6-a5ff-8672f343c82d req-52575039-3689-47ba-b4db-eed76808439c service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2df5f8f7-d751-4ca6-a5ff-8672f343c82d req-52575039-3689-47ba-b4db-eed76808439c service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2df5f8f7-d751-4ca6-a5ff-8672f343c82d req-52575039-3689-47ba-b4db-eed76808439c service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2df5f8f7-d751-4ca6-a5ff-8672f343c82d req-52575039-3689-47ba-b4db-eed76808439c service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-2df5f8f7-d751-4ca6-a5ff-8672f343c82d req-52575039-3689-47ba-b4db-eed76808439c service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:28 user nova-compute[75648]: WARNING nova.compute.manager [req-2df5f8f7-d751-4ca6-a5ff-8672f343c82d req-52575039-3689-47ba-b4db-eed76808439c service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd for instance with vm_state active and task_state None.
Nov 15 05:40:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-c93c2719-0e33-4325-b427-dda7ccb03a37 req-68c88734-3686-4488-8d1b-6a203b7ff94d service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c93c2719-0e33-4325-b427-dda7ccb03a37 req-68c88734-3686-4488-8d1b-6a203b7ff94d service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c93c2719-0e33-4325-b427-dda7ccb03a37 req-68c88734-3686-4488-8d1b-6a203b7ff94d service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c93c2719-0e33-4325-b427-dda7ccb03a37 req-68c88734-3686-4488-8d1b-6a203b7ff94d service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-c93c2719-0e33-4325-b427-dda7ccb03a37 req-68c88734-3686-4488-8d1b-6a203b7ff94d service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:30 user nova-compute[75648]: WARNING nova.compute.manager [req-c93c2719-0e33-4325-b427-dda7ccb03a37 req-68c88734-3686-4488-8d1b-6a203b7ff94d service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd for instance with vm_state active and task_state None.
Nov 15 05:40:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "f2657470-018b-4c83-a7d2-4433401a7e17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:40:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:40:31 user nova-compute[75648]: INFO nova.compute.claims [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Claim successful on node user
Nov 15 05:40:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.475s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:40:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:40:32 user nova-compute[75648]: DEBUG nova.policy [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd4a8513df14fc7ab09905d24220ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea832b577b9445782f27e28b1023e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:40:32 user nova-compute[75648]: INFO nova.virt.block_device [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Booting with volume snapshot 05257fd7-3188-49b9-a31f-11cd787d77b0 at /dev/vda
Nov 15 05:40:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Successfully created port: ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Successfully updated port: ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "refresh_cache-f2657470-018b-4c83-a7d2-4433401a7e17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquired lock "refresh_cache-f2657470-018b-4c83-a7d2-4433401a7e17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-changed-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Refreshing instance network info cache due to event network-changed-ff88f0da-40c2-4341-93a3-2a0fd0c4540a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] Acquiring lock "refresh_cache-f2657470-018b-4c83-a7d2-4433401a7e17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:40:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Updating instance_info_cache with network_info: [{"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Releasing lock "refresh_cache-f2657470-018b-4c83-a7d2-4433401a7e17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Instance network_info: |[{"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] Acquired lock "refresh_cache-f2657470-018b-4c83-a7d2-4433401a7e17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Refreshing network info cache for port ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Updated VIF entry in instance network info cache for port ff88f0da-40c2-4341-93a3-2a0fd0c4540a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Updating instance_info_cache with network_info: [{"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-960d0221-7eb8-4fa0-ae10-f22dfda89c6d req-e940580a-d887-4338-9ffa-d07eb73b7f60 service nova] Releasing lock "refresh_cache-f2657470-018b-4c83-a7d2-4433401a7e17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG os_brick.utils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[867d838c-abf3-4a9e-9c4a-f3848267dfea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8400dbdf-d049-4be3-bd1c-3180defc549d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e1ed3-b4f1-4e00-8932-74d9bad14321]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5792e-7288-4e93-940a-b9c51f4e65be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:38 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:40:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d350e91a-6c4e-47a7-8dab-af54f45d8988]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG os_brick.utils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:38 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Updating existing volume attachment record: 78a2113b-96f8-42e1-a1c6-2cb3f27419b4 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:40:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:40 user nova-compute[75648]: INFO nova.compute.manager [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] instance snapshotting
Nov 15 05:40:40 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Beginning live snapshot process
Nov 15 05:40:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:42 user nova-compute[75648]: INFO nova.compute.manager [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Rescuing
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json -f qcow2" returned: 0 in 0.780s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0czzb0_m/9a73de93b3764c188bfce899d1ce4645.delta 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp0czzb0_m/9a73de93b3764c188bfce899d1ce4645.delta 1073741824" returned: 0 in 0.066s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 05:40:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75648) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 15 05:40:42 user nova-compute[75648]: INFO nova.virt.libvirt.host [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] UEFI support detected
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing instance network info cache due to event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-c5f06d23-2a02-41fb-b4b1-b5cd34151c53 req-759f068d-a300-46be-be7e-9eb59356e168 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-unplugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c5f06d23-2a02-41fb-b4b1-b5cd34151c53 req-759f068d-a300-46be-be7e-9eb59356e168 service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c5f06d23-2a02-41fb-b4b1-b5cd34151c53 req-759f068d-a300-46be-be7e-9eb59356e168 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c5f06d23-2a02-41fb-b4b1-b5cd34151c53 req-759f068d-a300-46be-be7e-9eb59356e168 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-c5f06d23-2a02-41fb-b4b1-b5cd34151c53 req-759f068d-a300-46be-be7e-9eb59356e168 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-unplugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:43 user nova-compute[75648]: WARNING nova.compute.manager [req-c5f06d23-2a02-41fb-b4b1-b5cd34151c53 req-759f068d-a300-46be-be7e-9eb59356e168 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-unplugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state active and task_state rescuing.
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:40:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Creating image(s)
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Ensure instance console log exists: /opt/stack/data/nova/instances/f2657470-018b-4c83-a7d2-4433401a7e17/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Start _get_guest_xml network_info=[{"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '78a2113b-96f8-42e1-a1c6-2cb3f27419b4', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJBtLPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2657470-018b-4c83-a7d2-4433401a7e17', 'attached_at': '', 'detached_at': '', 'volume_id': '4f51ed74-b7d5-4069-ac66-647e2cd682ba', 'serial': '4f51ed74-b7d5-4069-ac66-647e2cd682ba'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:40:43 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:43 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJBtLPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:43 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] COPY block job progress, current cursor: 262144 final cursor: 75497472 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5079a86-53b5-4105-8a4c-156c2bbd994b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:40:43 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15341de-3a79-4543-83d8-4e29ea5e63c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba] added
Nov 15 05:40:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.067s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce76b097-676d-43c8-8c44-2d0c579b9134]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5c0a5-851b-42d9-beaf-93c19a2f7800]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJBtLPoC {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UJBtLPoC" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b15d16-57cf-4548-9c8a-bf9468d568cb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UJBtLPoC'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.042s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1108ff-cf18-45a8-a6d4-fa96a926f71f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3692ed48-072b-4a00-b6e2-929aa1d638da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance destroyed successfully.
Nov 15 05:40:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Attempting rescue
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75648) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:40:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Creating image(s)
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'trusted_certs' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[704c5944-cde8-494a-a121-58c3f7f065fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260]
Nov 15 05:40:43 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260] successful.
Nov 15 05:40:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aba803e-eecd-4000-bf45-5c3b9320d1a8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe60834-22dd-498d-89fd-4de03ab48fdc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:43 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b12725-b981-41e9-b778-99e9de11ed92]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJBtLPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updated VIF entry in instance network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:40:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bf4af60d-5525-4177-9194-5ea54dc24c57 req-694390cd-b644-45ed-b2a3-c8e847e86f30 service nova] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0czzb0_m/9a73de93b3764c188bfce899d1ce4645.delta /opt/stack/data/nova/instances/snapshots/tmp0czzb0_m/9a73de93b3764c188bfce899d1ce4645 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lazy-loading 'flavor' on Instance uuid 5d79d7ce-24cf-4a16-8e0f-769417a4bece {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.242s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue" returned: 0 in 0.083s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.329s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'migration_context' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.160s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.base [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<50d2b30f-82e8-46fe-8a7b-f227ba756995> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Start _get_guest_xml network_info=[{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:a5:f2:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'resources' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.base [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<50d2b30f-82e8-46fe-8a7b-f227ba756995> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'numa_topology' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.base [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<50d2b30f-82e8-46fe-8a7b-f227ba756995> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:40:44 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:44 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.base [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<50d2b30f-82e8-46fe-8a7b-f227ba756995> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1801397757',display_name='tempest-ServerRescueNegativeTestJSON-server-1801397757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1801397757',id=3,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-ictjapfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:09Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=50d2b30f-82e8-46fe-8a7b-f227ba756995,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:a5:f2:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:a5:f2:32"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'pci_devices' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.objects.base [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<50d2b30f-82e8-46fe-8a7b-f227ba756995> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:40:44 user nova-compute[75648]:   <uuid>50d2b30f-82e8-46fe-8a7b-f227ba756995</uuid>
Nov 15 05:40:44 user nova-compute[75648]:   <name>instance-00000003</name>
Nov 15 05:40:44 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:40:44 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:40:44 user nova-compute[75648]:   <metadata>
Nov 15 05:40:44 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:40:44 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:40:44 user nova-compute[75648]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1801397757</nova:name>
Nov 15 05:40:44 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:40:44</nova:creationTime>
Nov 15 05:40:44 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:40:44 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:40:44 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:40:44 user nova-compute[75648]:       <nova:owner>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:user uuid="e20600cd4fd148b1b871195e1e5397d7">tempest-ServerRescueNegativeTestJSON-1116175393-project-member</nova:user>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:project uuid="1ba132e2da344b8da008767a69ba0f3f">tempest-ServerRescueNegativeTestJSON-1116175393</nova:project>
Nov 15 05:40:44 user nova-compute[75648]:       </nova:owner>
Nov 15 05:40:44 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:40:44 user nova-compute[75648]:       <nova:ports>
Nov 15 05:40:44 user nova-compute[75648]:         <nova:port uuid="2322248d-0c65-4479-a167-4070d5a5d87e">
Nov 15 05:40:44 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 05:40:44 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:44 user nova-compute[75648]:       </nova:ports>
Nov 15 05:40:44 user nova-compute[75648]:     </nova:instance>
Nov 15 05:40:44 user nova-compute[75648]:   </metadata>
Nov 15 05:40:44 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:40:44 user nova-compute[75648]:     <system>
Nov 15 05:40:44 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:40:44 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:40:44 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:40:44 user nova-compute[75648]:       <entry name="serial">50d2b30f-82e8-46fe-8a7b-f227ba756995</entry>
Nov 15 05:40:44 user nova-compute[75648]:       <entry name="uuid">50d2b30f-82e8-46fe-8a7b-f227ba756995</entry>
Nov 15 05:40:44 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:40:44 user nova-compute[75648]:     </system>
Nov 15 05:40:44 user nova-compute[75648]:   </sysinfo>
Nov 15 05:40:44 user nova-compute[75648]:   <os>
Nov 15 05:40:44 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:40:44 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:40:44 user nova-compute[75648]:   </os>
Nov 15 05:40:44 user nova-compute[75648]:   <features>
Nov 15 05:40:44 user nova-compute[75648]:     <acpi/>
Nov 15 05:40:44 user nova-compute[75648]:     <apic/>
Nov 15 05:40:44 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:40:44 user nova-compute[75648]:   </features>
Nov 15 05:40:44 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:40:44 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:40:44 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:40:44 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:40:44 user nova-compute[75648]:   </clock>
Nov 15 05:40:44 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:40:44 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:40:44 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:40:44 user nova-compute[75648]:   </cpu>
Nov 15 05:40:44 user nova-compute[75648]:   <devices>
Nov 15 05:40:44 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:40:44 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:40:44 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue"/>
Nov 15 05:40:44 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:40:44 user nova-compute[75648]:     </disk>
Nov 15 05:40:44 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:40:44 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:40:44 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk"/>
Nov 15 05:40:44 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:40:44 user nova-compute[75648]:     </disk>
Nov 15 05:40:44 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:44 user nova-compute[75648]:       <mac address="fa:16:3e:a5:f2:32"/>
Nov 15 05:40:44 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:44 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:44 user nova-compute[75648]:       <target dev="tap2322248d-0c"/>
Nov 15 05:40:44 user nova-compute[75648]:     </interface>
Nov 15 05:40:44 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:40:44 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/console.log" append="off"/>
Nov 15 05:40:44 user nova-compute[75648]:     </serial>
Nov 15 05:40:44 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:40:44 user nova-compute[75648]:     <video>
Nov 15 05:40:44 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:44 user nova-compute[75648]:     </video>
Nov 15 05:40:44 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:40:44 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:40:44 user nova-compute[75648]:     </rng>
Nov 15 05:40:44 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:40:44 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:40:44 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:40:44 user nova-compute[75648]:     </memballoon>
Nov 15 05:40:44 user nova-compute[75648]:   </devices>
Nov 15 05:40:44 user nova-compute[75648]: </domain>
Nov 15 05:40:44 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:40:44 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance destroyed successfully.
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:44 user nova-compute[75648]: INFO nova.compute.manager [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Attaching volume e975b607-70ff-4b97-8d02-f9d034fa1290 to /dev/vdb
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:a5:f2:32, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.utils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp0czzb0_m/9a73de93b3764c188bfce899d1ce4645.delta /opt/stack/data/nova/instances/snapshots/tmp0czzb0_m/9a73de93b3764c188bfce899d1ce4645" returned: 0 in 0.611s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:44 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Snapshot extracted, beginning image upload
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d045f8d-4d7b-49ff-8441-edf7b7c58d16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37ee625-9e60-4f8a-916d-21dd9e900b8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0660e758-2011-42cf-9562-725fa0edff81]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5c0e47-2368-4f75-842a-b199a5c35fc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:40:44 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ba4e5a-60c4-48bf-a646-0d8ad3736a37]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.utils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Updating existing volume attachment record: 50bc144e-c199-4f97-8841-deb52f5c4104 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing instance network info cache due to event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.network.neutron [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.511s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== connect_volume: return (1513ms) {'type': 'block', 'scsi_wwn': '23866623039393036', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866623039393036', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1384021572',display_name='tempest-TestVolumeBootPattern-server-1384021572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1384021572',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-djystsx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:40:33Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=f2657470-018b-4c83-a7d2-4433401a7e17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'pci_devices' on Instance uuid f2657470-018b-4c83-a7d2-4433401a7e17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:40:45 user nova-compute[75648]:   <uuid>f2657470-018b-4c83-a7d2-4433401a7e17</uuid>
Nov 15 05:40:45 user nova-compute[75648]:   <name>instance-0000000d</name>
Nov 15 05:40:45 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:40:45 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:40:45 user nova-compute[75648]:   <metadata>
Nov 15 05:40:45 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:40:45 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:40:45 user nova-compute[75648]:       <nova:name>tempest-TestVolumeBootPattern-server-1384021572</nova:name>
Nov 15 05:40:45 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:40:43</nova:creationTime>
Nov 15 05:40:45 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:40:45 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:40:45 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:40:45 user nova-compute[75648]:       <nova:owner>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:user uuid="2fd4a8513df14fc7ab09905d24220ae1">tempest-TestVolumeBootPattern-522670763-project-member</nova:user>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:project uuid="bea832b577b9445782f27e28b1023e96">tempest-TestVolumeBootPattern-522670763</nova:project>
Nov 15 05:40:45 user nova-compute[75648]:       </nova:owner>
Nov 15 05:40:45 user nova-compute[75648]:       <nova:ports>
Nov 15 05:40:45 user nova-compute[75648]:         <nova:port uuid="ff88f0da-40c2-4341-93a3-2a0fd0c4540a">
Nov 15 05:40:45 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:40:45 user nova-compute[75648]:         </nova:port>
Nov 15 05:40:45 user nova-compute[75648]:       </nova:ports>
Nov 15 05:40:45 user nova-compute[75648]:     </nova:instance>
Nov 15 05:40:45 user nova-compute[75648]:   </metadata>
Nov 15 05:40:45 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:40:45 user nova-compute[75648]:     <system>
Nov 15 05:40:45 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:40:45 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:40:45 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:40:45 user nova-compute[75648]:       <entry name="serial">f2657470-018b-4c83-a7d2-4433401a7e17</entry>
Nov 15 05:40:45 user nova-compute[75648]:       <entry name="uuid">f2657470-018b-4c83-a7d2-4433401a7e17</entry>
Nov 15 05:40:45 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:40:45 user nova-compute[75648]:     </system>
Nov 15 05:40:45 user nova-compute[75648]:   </sysinfo>
Nov 15 05:40:45 user nova-compute[75648]:   <os>
Nov 15 05:40:45 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:40:45 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:40:45 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:40:45 user nova-compute[75648]:   </os>
Nov 15 05:40:45 user nova-compute[75648]:   <features>
Nov 15 05:40:45 user nova-compute[75648]:     <acpi/>
Nov 15 05:40:45 user nova-compute[75648]:     <apic/>
Nov 15 05:40:45 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:40:45 user nova-compute[75648]:   </features>
Nov 15 05:40:45 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:40:45 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:40:45 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:40:45 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:40:45 user nova-compute[75648]:   </clock>
Nov 15 05:40:45 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:40:45 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:40:45 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:40:45 user nova-compute[75648]:   </cpu>
Nov 15 05:40:45 user nova-compute[75648]:   <devices>
Nov 15 05:40:45 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:40:45 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:40:45 user nova-compute[75648]:       <source dev="/dev/sde"/>
Nov 15 05:40:45 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:40:45 user nova-compute[75648]:       <serial>4f51ed74-b7d5-4069-ac66-647e2cd682ba</serial>
Nov 15 05:40:45 user nova-compute[75648]:     </disk>
Nov 15 05:40:45 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:40:45 user nova-compute[75648]:       <mac address="fa:16:3e:62:5e:84"/>
Nov 15 05:40:45 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:45 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:40:45 user nova-compute[75648]:       <target dev="tapff88f0da-40"/>
Nov 15 05:40:45 user nova-compute[75648]:     </interface>
Nov 15 05:40:45 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:40:45 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/f2657470-018b-4c83-a7d2-4433401a7e17/console.log" append="off"/>
Nov 15 05:40:45 user nova-compute[75648]:     </serial>
Nov 15 05:40:45 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:40:45 user nova-compute[75648]:     <video>
Nov 15 05:40:45 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:40:45 user nova-compute[75648]:     </video>
Nov 15 05:40:45 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:40:45 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:40:45 user nova-compute[75648]:     </rng>
Nov 15 05:40:45 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:40:45 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:40:45 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:40:45 user nova-compute[75648]:     </memballoon>
Nov 15 05:40:45 user nova-compute[75648]:   </devices>
Nov 15 05:40:45 user nova-compute[75648]: </domain>
Nov 15 05:40:45 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1384021572',display_name='tempest-TestVolumeBootPattern-server-1384021572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1384021572',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-djystsx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:40:33Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=f2657470-018b-4c83-a7d2-4433401a7e17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG os_vif [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '680c558c-4805-5fb8-a63a-434514368103', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff88f0da-40, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff88f0da-40, col_values=(('qos', UUID('66bae8c4-a20c-4dce-bf56-718458153403')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff88f0da-40, col_values=(('external_ids', {'iface-id': 'ff88f0da-40c2-4341-93a3-2a0fd0c4540a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:5e:84', 'vm-uuid': 'f2657470-018b-4c83-a7d2-4433401a7e17'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:45 user nova-compute[75648]: INFO os_vif [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40')
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No VIF found with MAC fa:16:3e:62:5e:84, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-6415f99b-ba69-45b8-b1ee-0ae321e7cad9 req-7beb0417-2e38-4471-abd2-61640718e513 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6415f99b-ba69-45b8-b1ee-0ae321e7cad9 req-7beb0417-2e38-4471-abd2-61640718e513 service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6415f99b-ba69-45b8-b1ee-0ae321e7cad9 req-7beb0417-2e38-4471-abd2-61640718e513 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6415f99b-ba69-45b8-b1ee-0ae321e7cad9 req-7beb0417-2e38-4471-abd2-61640718e513 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-6415f99b-ba69-45b8-b1ee-0ae321e7cad9 req-7beb0417-2e38-4471-abd2-61640718e513 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:45 user nova-compute[75648]: WARNING nova.compute.manager [req-6415f99b-ba69-45b8-b1ee-0ae321e7cad9 req-7beb0417-2e38-4471-abd2-61640718e513 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state active and task_state rescuing.
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.neutron [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updated VIF entry in instance network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.neutron [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8aa318a9-fce4-4d55-ac73-8a03b6b82d63 req-2ff9c70e-ef62-48da-b032-8c62e0409e48 service nova] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:45 user nova-compute[75648]: INFO nova.compute.manager [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] instance snapshotting
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:40:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Beginning live snapshot process
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:46 user nova-compute[75648]: INFO nova.compute.manager [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Shelving
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptthgyx22/b4a3bc3cb026410abea875235bf92781.delta 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmptthgyx22/b4a3bc3cb026410abea875235bf92781.delta 1073741824" returned: 0 in 0.058s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 05:40:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-207134ac-de5c-4073-bd52-b1b7720d912d req-dd7b5e08-44cd-4c47-9939-37bbc4c7d7f6 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-unplugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-207134ac-de5c-4073-bd52-b1b7720d912d req-dd7b5e08-44cd-4c47-9939-37bbc4c7d7f6 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-207134ac-de5c-4073-bd52-b1b7720d912d req-dd7b5e08-44cd-4c47-9939-37bbc4c7d7f6 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-207134ac-de5c-4073-bd52-b1b7720d912d req-dd7b5e08-44cd-4c47-9939-37bbc4c7d7f6 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-207134ac-de5c-4073-bd52-b1b7720d912d req-dd7b5e08-44cd-4c47-9939-37bbc4c7d7f6 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-unplugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:47 user nova-compute[75648]: WARNING nova.compute.manager [req-207134ac-de5c-4073-bd52-b1b7720d912d req-dd7b5e08-44cd-4c47-9939-37bbc4c7d7f6 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-unplugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state active and task_state shelving.
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-697f3d1e-d620-46a8-9ec4-bce1107d20a0 req-9bf09ffe-957d-43eb-8024-e676849e6f92 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-697f3d1e-d620-46a8-9ec4-bce1107d20a0 req-9bf09ffe-957d-43eb-8024-e676849e6f92 service nova] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-697f3d1e-d620-46a8-9ec4-bce1107d20a0 req-9bf09ffe-957d-43eb-8024-e676849e6f92 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-697f3d1e-d620-46a8-9ec4-bce1107d20a0 req-9bf09ffe-957d-43eb-8024-e676849e6f92 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-697f3d1e-d620-46a8-9ec4-bce1107d20a0 req-9bf09ffe-957d-43eb-8024-e676849e6f92 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] No waiting events found dispatching network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:47 user nova-compute[75648]: WARNING nova.compute.manager [req-697f3d1e-d620-46a8-9ec4-bce1107d20a0 req-9bf09ffe-957d-43eb-8024-e676849e6f92 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received unexpected event network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a for instance with vm_state building and task_state spawning.
Nov 15 05:40:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Snapshot image upload complete
Nov 15 05:40:47 user nova-compute[75648]: INFO nova.compute.manager [None req-f85f0773-e4ef-467d-bbd1-463638d42b63 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Took 6.76 seconds to snapshot the instance on the hypervisor.
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:40:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 05:40:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance destroyed successfully.
Nov 15 05:40:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Beginning cold snapshot process
Nov 15 05:40:48 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptthgyx22/b4a3bc3cb026410abea875235bf92781.delta /opt/stack/data/nova/instances/snapshots/tmptthgyx22/b4a3bc3cb026410abea875235bf92781 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:40:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk /opt/stack/data/nova/instances/snapshots/tmpgvi4zs__/7ba95afe2cfb47a9a6cd33b6d3eba408 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmptthgyx22/b4a3bc3cb026410abea875235bf92781.delta /opt/stack/data/nova/instances/snapshots/tmptthgyx22/b4a3bc3cb026410abea875235bf92781" returned: 0 in 0.224s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Snapshot extracted, beginning image upload
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-ab05ac32-0114-48fd-8028-01c936303785 req-8b984d3f-c6e8-4f04-805f-7bcf82bf684b service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ab05ac32-0114-48fd-8028-01c936303785 req-8b984d3f-c6e8-4f04-805f-7bcf82bf684b service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ab05ac32-0114-48fd-8028-01c936303785 req-8b984d3f-c6e8-4f04-805f-7bcf82bf684b service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ab05ac32-0114-48fd-8028-01c936303785 req-8b984d3f-c6e8-4f04-805f-7bcf82bf684b service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-ab05ac32-0114-48fd-8028-01c936303785 req-8b984d3f-c6e8-4f04-805f-7bcf82bf684b service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:49 user nova-compute[75648]: WARNING nova.compute.manager [req-ab05ac32-0114-48fd-8028-01c936303785 req-8b984d3f-c6e8-4f04-805f-7bcf82bf684b service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state active and task_state shelving_image_pending_upload.
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] No waiting events found dispatching network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:49 user nova-compute[75648]: WARNING nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received unexpected event network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a for instance with vm_state building and task_state spawning.
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:49 user nova-compute[75648]: WARNING nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state active and task_state rescuing.
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:49 user nova-compute[75648]: WARNING nova.compute.manager [req-0e27bb7a-a7ae-449b-9747-1ad68ded830c req-5eccc400-5d2e-4b55-9821-8beacc50b922 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state active and task_state rescuing.
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk /opt/stack/data/nova/instances/snapshots/tmpgvi4zs__/7ba95afe2cfb47a9a6cd33b6d3eba408" returned: 0 in 0.698s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Snapshot extracted, beginning image upload
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeYMLVck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:49 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:49 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:49 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[74458e09-a677-4ef6-9fe0-d4cd8afa7f18]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:40:49 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a36cbb-bf07-49a9-88eb-e7f45907a253]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290] added
Nov 15 05:40:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d397e6bc-e4c1-43e4-b65c-a6507cf7c1ae]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25452f44-f7b2-457f-936e-bb16bca5e6e9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeYMLVck {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JeYMLVck" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8908166d-88b2-43a9-b73a-1c6fd28bf3d2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JeYMLVck'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fee10b-a56d-4dd5-9d1b-ae9b9547daf4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a285fe-0750-4167-b142-0939b368b15e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[394d49ff-c776-4c90-a63b-cda155e81d55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260]
Nov 15 05:40:50 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260] successful.
Nov 15 05:40:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c52e520-a094-4d01-bab7-325074cd6056]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ca2e65-bd74-4313-b46e-a6b0eefe7e81]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:50 user nova-compute[75648]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 (non-flash)
Nov 15 05:40:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ddefd8-b1da-40d4-994f-0ea06443e857]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeYMLVck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:40:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Instance spawned successfully.
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:40:50 user nova-compute[75648]: INFO nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Took 7.49 seconds to spawn the instance on the hypervisor.
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cee87d66-181f-4c37-a180-07e7f3ab9e10 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:51 user nova-compute[75648]: INFO nova.compute.manager [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Took 19.14 seconds to build instance.
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c5b712e8-daa4-41a1-92fb-6364feb94bf2 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "f2657470-018b-4c83-a7d2-4433401a7e17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.229s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '26434306530303465', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434306530303465', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG nova.objects.instance [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lazy-loading 'flavor' on Instance uuid 5d79d7ce-24cf-4a16-8e0f-769417a4bece {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:40:51 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:40:51 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:40:51 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:40:51 user nova-compute[75648]:   <serial>e975b607-70ff-4b97-8d02-f9d034fa1290</serial>
Nov 15 05:40:51 user nova-compute[75648]: </disk>
Nov 15 05:40:51 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] No VIF found with MAC fa:16:3e:ca:cc:ad, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Snapshot image upload complete
Nov 15 05:40:52 user nova-compute[75648]: INFO nova.compute.manager [None req-795c393d-fb6b-4edf-846d-df1bf1594322 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Took 6.46 seconds to snapshot the instance on the hypervisor.
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-02feb87c-5cf3-46c1-b440-8aeff74cd7bd tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.803s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:40:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Snapshot image upload complete
Nov 15 05:40:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:53 user nova-compute[75648]: INFO nova.compute.manager [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Shelve offloading
Nov 15 05:40:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance destroyed successfully.
Nov 15 05:40:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:53 user nova-compute[75648]: INFO nova.compute.manager [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Terminating instance
Nov 15 05:40:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-b8ac591e-e3dc-44e6-81f3-26bb9e453678 req-43223a04-045e-40f9-a025-6aa345c524bf service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-vif-unplugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b8ac591e-e3dc-44e6-81f3-26bb9e453678 req-43223a04-045e-40f9-a025-6aa345c524bf service nova] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b8ac591e-e3dc-44e6-81f3-26bb9e453678 req-43223a04-045e-40f9-a025-6aa345c524bf service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b8ac591e-e3dc-44e6-81f3-26bb9e453678 req-43223a04-045e-40f9-a025-6aa345c524bf service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-b8ac591e-e3dc-44e6-81f3-26bb9e453678 req-43223a04-045e-40f9-a025-6aa345c524bf service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] No waiting events found dispatching network-vif-unplugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-b8ac591e-e3dc-44e6-81f3-26bb9e453678 req-43223a04-045e-40f9-a025-6aa345c524bf service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-vif-unplugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:40:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Instance destroyed successfully.
Nov 15 05:40:54 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:54 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=6886MB free_disk=25.50952911376953GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lazy-loading 'resources' on Instance uuid 5d79d7ce-24cf-4a16-8e0f-769417a4bece {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1780391563',display_name='tempest-DeleteServersTestJSON-server-1780391563',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1780391563',id=5,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0129d4b74f2b4e8fb0214cc31ec5f23e',ramdisk_id='',reservation_id='r-dnklwsye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1085885807',owner_user_name='tempest-DeleteServersTestJSON-1085885807-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:39:11Z,user_data=None,user_id='d58a0aa9d3a3414b9a9e16385495c354',uuid=5d79d7ce-24cf-4a16-8e0f-769417a4bece,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Converting VIF {"id": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "address": "fa:16:3e:ca:cc:ad", "network": {"id": "cdf446ca-c0b6-4d7b-a609-b7124c7e6669", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-576354681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0129d4b74f2b4e8fb0214cc31ec5f23e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap893338cf-60", "ovs_interfaceid": "893338cf-60d8-4816-b724-9c0c18ea0eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:54 user nova-compute[75648]: DEBUG os_vif [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap893338cf-60, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07b76ca2-5336-4f7a-96e6-4f696eb10ecd) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: INFO os_vif [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:cc:ad,bridge_name='br-int',has_traffic_filtering=True,id=893338cf-60d8-4816-b724-9c0c18ea0eb2,network=Network(cdf446ca-c0b6-4d7b-a609-b7124c7e6669),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap893338cf-60')
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JeYMLVck', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:40:55 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93359c9c-1cb1-4460-be81-66cba886e4cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:40:55 user nova-compute[75648]: No targets found.
Nov 15 05:40:55 user nova-compute[75648]: iSNS:
Nov 15 05:40:55 user nova-compute[75648]: No targets found.
Nov 15 05:40:55 user nova-compute[75648]: STATIC:
Nov 15 05:40:55 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3
Nov 15 05:40:55 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:40:55 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:40:55 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:40:55 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:40:55 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:40:55 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:40:55 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:40:55 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:40:55 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290
Nov 15 05:40:55 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:40:55 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:40:55 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:40:55 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:40:55 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:40:55 user nova-compute[75648]: FIRMWARE:
Nov 15 05:40:55 user nova-compute[75648]: No targets found.
Nov 15 05:40:55 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:40:55 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:40:55 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40cecf5-84f6-4733-98e9-9ccdb48dc853]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae5819b-deff-4ad1-9094-c77f29b4d8dc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:40:55 user nova-compute[75648]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 (non-flash)
Nov 15 05:40:55 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e878fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290'): ({'sdf'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Removing single pathed devices sdf {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 4d78e23e-b1d9-4395-9885-c515e558f673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5d79d7ce-24cf-4a16-8e0f-769417a4bece actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance bd28591c-ff83-40f9-8298-9fab5de1dcbc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f2657470-018b-4c83-a7d2-4433401a7e17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[427670ff-2efa-43ee-921b-c2aa6f430c9d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9863f098-2b4f-4669-8efa-612f1a93876e]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Flushing IO for device /dev/sdf {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[996546bd-83cc-4bec-b85f-fba18b92a265]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5909bbab-47d7-4c6c-b105-c0f75c463b2c]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4afed1-4b7d-40bc-8859-049756a7ee2b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e080f57-428a-4fb6-9a5d-08526cde8794]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260]
Nov 15 05:40:55 user nova-compute[75648]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290, portal: 172.16.0.220,3260] successful.
Nov 15 05:40:55 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e975b607-70ff-4b97-8d02-f9d034fa1290 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8224d06-303f-4dab-8f47-7c4e93a8592a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] <== disconnect_volume: return (374ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Deleting instance files /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece_del
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Deletion of /opt/stack/data/nova/instances/5d79d7ce-24cf-4a16-8e0f-769417a4bece_del complete
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance destroyed successfully.
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'resources' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing instance network info cache due to event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-66321000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-66321000',id=4,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDT+QGtGruou8hlWAeV8P8X62pba6X7eOjVaz/tvu5u3SCbGg/SxnXOtKGrikVZrRneh/S1kvQSGR2M/f/nHBiMy9u1xauxL+Y3J+AuoDGdIUtVKPP72cn9HYYFfyNF3cQ==',key_name='tempest-keypair-2114855632',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-0dc600ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member',shelved_at='2023-11-15T05:40:53.341694',shelved_host='user',shelved_image_id='f031c544-e1ea-41aa-9052-24b4aac8d2f3'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=4d78e23e-b1d9-4395-9885-c515e558f673,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG os_vif [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf91e5406-2b, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=329dac08-344f-45e2-94cf-f436f25bfc2e) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.compute.manager [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Took 1.78 seconds to destroy the instance on the hypervisor.
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:40:55 user nova-compute[75648]: INFO os_vif [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b')
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Deleting instance files /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673_del
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Deletion of /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673_del complete
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:55 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Deleted allocations for instance 4d78e23e-b1d9-4395-9885-c515e558f673
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.objects.base [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<4d78e23e-b1d9-4395-9885-c515e558f673> lazy-loaded attributes: resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updated VIF entry in instance network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf91e5406-2b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bd3d6909-20fb-47e9-81d7-bebf1b14c2b3 req-2da6710b-0f4a-4419-9688-0b7f95393649 service nova] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:40:56 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Took 0.58 seconds to deallocate network for instance.
Nov 15 05:40:56 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] Acquiring lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] No waiting events found dispatching network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:40:56 user nova-compute[75648]: WARNING nova.compute.manager [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received unexpected event network-vif-plugged-893338cf-60d8-4816-b724-9c0c18ea0eb2 for instance with vm_state active and task_state deleting.
Nov 15 05:40:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b1afddb-1155-4f02-a9f7-b55de1b35d0b req-f4427720-aed5-4acb-a19a-1855f370950b service nova] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Received event network-vif-deleted-893338cf-60d8-4816-b724-9c0c18ea0eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e59697bc-c5ab-4161-9791-4ba7fbb4a3e9 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.538s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:40:56 user nova-compute[75648]: INFO nova.compute.manager [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] [instance: 5d79d7ce-24cf-4a16-8e0f-769417a4bece] Took 0.85 seconds to detach 1 volumes for instance.
Nov 15 05:40:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:40:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:40:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:40:57 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:40:57 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:40:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:40:57 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Deleted allocations for instance 5d79d7ce-24cf-4a16-8e0f-769417a4bece
Nov 15 05:40:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f8ab61a-0d05-4a57-b163-dedd4e01e910 tempest-DeleteServersTestJSON-1085885807 tempest-DeleteServersTestJSON-1085885807-project-member] Lock "5d79d7ce-24cf-4a16-8e0f-769417a4bece" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.796s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-changed-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Refreshing instance network info cache due to event network-changed-d90f49d6-d3f5-4220-ae8d-13d52f62216f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] Acquiring lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] Acquired lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Refreshing network info cache for port d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updated VIF entry in instance network info cache for port d90f49d6-d3f5-4220-ae8d-13d52f62216f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updating instance_info_cache with network_info: [{"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dcf70683-b3f3-474a-b413-175365615a0a req-6b38b87a-b18f-456c-b231-4bec99b69861 service nova] Releasing lock "refresh_cache-bd28591c-ff83-40f9-8298-9fab5de1dcbc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-changed-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Refreshing instance network info cache due to event network-changed-c584c83b-4c1f-47ad-bbda-60412268bef6. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] Acquiring lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] Acquired lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Refreshing network info cache for port c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG nova.network.neutron [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updated VIF entry in instance network info cache for port c584c83b-4c1f-47ad-bbda-60412268bef6. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG nova.network.neutron [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updating instance_info_cache with network_info: [{"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-482bef9e-a5b1-4bd5-9033-69c5d721461e req-d8defd92-663d-47c6-a9b5-7ef4d2d60ce2 service nova] Releasing lock "refresh_cache-177ad35a-a9fc-4c31-89d5-2592bb24bb4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG nova.objects.instance [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lazy-loading 'flavor' on Instance uuid bd28591c-ff83-40f9-8298-9fab5de1dcbc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:04 user nova-compute[75648]: INFO nova.compute.manager [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Attaching volume d25b4feb-9a18-4e44-bb1b-0896221c4ef9 to /dev/sdc
Nov 15 05:41:04 user nova-compute[75648]: DEBUG os_brick.utils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[55943568-9d08-4aaa-b2d1-a773273e0eae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de1378e-661c-415c-8884-a9c1093b1fb6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[646da1a6-3f6b-4239-939c-94ade298c77f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[409e2f88-f868-41dc-85b9-bb662367b130]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:04 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:04 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac40764-9453-4ea0-b61a-f6835ac72399]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG os_brick.utils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:04 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updating existing volume attachment record: 8f0c2c1b-9ffe-4948-ad0d-1b127e1e3969 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:41:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'flavor' on Instance uuid 177ad35a-a9fc-4c31-89d5-2592bb24bb4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:07 user nova-compute[75648]: INFO nova.compute.manager [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Attaching volume c4a815f5-fb26-4148-ac42-99699035f511 to /dev/vdb
Nov 15 05:41:07 user nova-compute[75648]: DEBUG os_brick.utils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ae2ad8-caea-4af3-9273-bfdbd340f502]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15bbc1c-e3e3-4d11-b376-ed36743e8624]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f18ad5-bd08-49ca-89fd-0dfa691d885c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c224c82-94de-4758-8e3e-a4f01e848c4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:07 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[355b8cf4-d253-493b-ac2d-ccb99cc605e9]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG os_brick.utils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:07 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updating existing volume attachment record: abd82d6b-4845-4477-8f4b-419cd952479b {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-changed-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Refreshing instance network info cache due to event network-changed-76b8b8e6-c430-4222-a726-7a45dd82c22b. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] Acquiring lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] Acquired lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Refreshing network info cache for port 76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.objects.instance [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lazy-loading 'flavor' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updated VIF entry in instance network info cache for port 76b8b8e6-c430-4222-a726-7a45dd82c22b. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updating instance_info_cache with network_info: [{"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b781453-9bf6-4072-ba9d-62366ed5c3c2 req-afc3299b-dfbb-4b9d-87dc-9535ced4c31d service nova] Releasing lock "refresh_cache-38f6fbf6-3909-49d8-ab29-fb57a1727394" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:08 user nova-compute[75648]: INFO nova.compute.manager [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Attaching volume b2d32e57-63ef-4c98-ab17-cd43abad7bff to /dev/vdb
Nov 15 05:41:08 user nova-compute[75648]: DEBUG os_brick.utils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95d5489-2eee-40b1-8097-7ebd4ea2bd9b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b549a6b8-30be-410e-95f9-56a63b53097b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640f082-9ec8-4d03-befe-0f687a8defd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c784def-2dd1-4dbd-8834-3b6b8d5d6791]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:08 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6714e88-4cee-4fce-9668-30ab221b090a]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG os_brick.utils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:08 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updating existing volume attachment record: 84eae282-77ab-4520-84a5-981eb434b615 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKNxaUBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:10 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:10 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:10 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4427fc76-45fe-4b30-ba8d-bb343e86aab2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:10 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9136e1-94c1-42d2-8047-9a422bae80c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9] added
Nov 15 05:41:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bcba30-4480-4ead-93cf-d56fa18a2eac]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8028a750-e402-4ad5-9f14-b193677ea122]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKNxaUBd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKNxaUBd" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f5f9ba-b4d5-4dbc-bff3-be47813bd55a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKNxaUBd'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e72c32-05bd-4b64-95b4-38e8580dd692]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a684c0d-2585-41f6-aa7a-918ce653049e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69ae5ab-9afd-46d1-a084-255f6304b645]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260]
Nov 15 05:41:10 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae16d56-7f81-455d-bd94-a5bdf968a5c3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a04a65-c17a-4f11-bee9-9d416f794d1a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:10 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aacbc07-8500-4fc9-9d6e-48039cb748fe]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKNxaUBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23831643865613765', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831643865613765', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.objects.instance [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lazy-loading 'flavor' on Instance uuid bd28591c-ff83-40f9-8298-9fab5de1dcbc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:41:11 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:11 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:41:11 user nova-compute[75648]:   <target dev="sdc" bus="scsi"/>
Nov 15 05:41:11 user nova-compute[75648]:   <serial>d25b4feb-9a18-4e44-bb1b-0896221c4ef9</serial>
Nov 15 05:41:11 user nova-compute[75648]:   <address type="drive" controller="0" unit="2"/>
Nov 15 05:41:11 user nova-compute[75648]: </disk>
Nov 15 05:41:11 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No BDM found with device name sda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] No VIF found with MAC fa:16:3e:31:15:86, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-97fb468f-8c70-420b-818d-10b449aba043 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.603s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvRjBKzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:12 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e995e9-b860-4a7c-af3c-2b955dc6ad06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:12 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[03846832-8dd0-4f67-83e5-1f156fe0c7ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511] added
Nov 15 05:41:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a17ca9d-ffc4-4a02-b70d-e0deac95face]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[34adc0af-b1ac-4870-8a4c-01c294797939]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvRjBKzW {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LvRjBKzW" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6226c12a-c1e7-441c-ad07-892a3e5418c3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LvRjBKzW'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79a7e76-45eb-40c2-afe1-ad1759d85c7b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce664846-94d4-4689-97a1-fba893899524]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:12 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6675e25d-9f87-42bf-8ea2-d396a5288485]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260]
Nov 15 05:41:12 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:12 user nova-compute[75648]: INFO nova.compute.manager [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Detaching volume d25b4feb-9a18-4e44-bb1b-0896221c4ef9
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.128s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69c46b6-8229-4c4e-867b-9ae682ba67d8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9fc797-caf1-404b-beb0-5bef1d1d027f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:13 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.394s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[07115bf2-8d49-4268-a922-0c804713d054]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:13 user nova-compute[75648]: INFO nova.virt.block_device [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Attempting to driver detach volume d25b4feb-9a18-4e44-bb1b-0896221c4ef9 from mountpoint /dev/sdc
Nov 15 05:41:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Attempting to detach device sdc from instance bd28591c-ff83-40f9-8298-9fab5de1dcbc from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:13 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:13 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:41:13 user nova-compute[75648]:   <target dev="sdc" bus="scsi"/>
Nov 15 05:41:13 user nova-compute[75648]:   <serial>d25b4feb-9a18-4e44-bb1b-0896221c4ef9</serial>
Nov 15 05:41:13 user nova-compute[75648]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 05:41:13 user nova-compute[75648]: </disk>
Nov 15 05:41:13 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Successfully detached device sdc from instance bd28591c-ff83-40f9-8298-9fab5de1dcbc from the persistent domain config.
Nov 15 05:41:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance bd28591c-ff83-40f9-8298-9fab5de1dcbc from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:13 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:13 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:41:13 user nova-compute[75648]:   <target dev="sdc" bus="scsi"/>
Nov 15 05:41:13 user nova-compute[75648]:   <serial>d25b4feb-9a18-4e44-bb1b-0896221c4ef9</serial>
Nov 15 05:41:13 user nova-compute[75648]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 15 05:41:13 user nova-compute[75648]: </disk>
Nov 15 05:41:13 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:13 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance bd28591c-ff83-40f9-8298-9fab5de1dcbc {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvRjBKzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.566s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] <== connect_volume: return (1567ms) {'type': 'block', 'scsi_wwn': '23633636635313135', 'path': '/dev/sdg'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633636635313135', 'path': '/dev/sdg'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.615s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:14 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG nova.objects.instance [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'flavor' on Instance uuid 177ad35a-a9fc-4c31-89d5-2592bb24bb4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3e68af-874b-4a65-ab98-60f26e3bb963]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:14 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:41:14 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:14 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:41:14 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:14 user nova-compute[75648]:   <serial>c4a815f5-fb26-4148-ac42-99699035f511</serial>
Nov 15 05:41:14 user nova-compute[75648]: </disk>
Nov 15 05:41:14 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca4f43a-8ea1-4070-b3ea-d8ca2a9597cc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff] added
Nov 15 05:41:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecd3e17-4882-416c-9f47-a5a26f3ea722]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f7d578-fd15-46c2-8519-b12db82e816c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbUXZLcw {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbUXZLcw" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f035290-0aa9-40b2-9b98-d4213bb9c3c0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mbUXZLcw'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f73d22-130d-4c25-b2d7-4a1435b16381]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdb6c2e-0b46-4eed-9e36-2541e4a92a71]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6163c13-b3a8-41cd-a027-4fa4820b4261]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]
Nov 15 05:41:14 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6413d8e0-617d-46df-854a-02ba832413e8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e06efd2-6075-417f-94d1-bd09a9a907af]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:14 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[416e6ad3-f486-460d-9731-258c968c016e]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No VIF found with MAC fa:16:3e:a1:6d:18, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:41:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-32c04cbe-cff2-468d-8d43-f4e4e6564dd6 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.052s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] <== connect_volume: return (1949ms) {'type': 'block', 'scsi_wwn': '23063653232303863', 'path': '/dev/sdh'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063653232303863', 'path': '/dev/sdh'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG nova.objects.instance [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lazy-loading 'flavor' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:41:15 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:15 user nova-compute[75648]:   <source dev="/dev/sdh"/>
Nov 15 05:41:15 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:15 user nova-compute[75648]:   <serial>b2d32e57-63ef-4c98-ab17-cd43abad7bff</serial>
Nov 15 05:41:15 user nova-compute[75648]: </disk>
Nov 15 05:41:15 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] No VIF found with MAC fa:16:3e:70:be:15, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:41:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bb40873d-6d08-41bd-98cb-1b0484277dfd tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.609s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:16 user nova-compute[75648]: INFO nova.compute.manager [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Detaching volume c4a815f5-fb26-4148-ac42-99699035f511
Nov 15 05:41:16 user nova-compute[75648]: INFO nova.virt.block_device [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Attempting to driver detach volume c4a815f5-fb26-4148-ac42-99699035f511 from mountpoint /dev/vdb
Nov 15 05:41:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Attempting to detach device vdb from instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:41:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:16 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:16 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:41:16 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:16 user nova-compute[75648]:   <serial>c4a815f5-fb26-4148-ac42-99699035f511</serial>
Nov 15 05:41:16 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:16 user nova-compute[75648]: </disk>
Nov 15 05:41:16 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:16 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Successfully detached device vdb from instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c from the persistent domain config.
Nov 15 05:41:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:41:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:16 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:16 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:41:16 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:16 user nova-compute[75648]:   <serial>c4a815f5-fb26-4148-ac42-99699035f511</serial>
Nov 15 05:41:16 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:16 user nova-compute[75648]: </disk>
Nov 15 05:41:16 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG os_brick.utils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e8089b-c069-4526-87e7-f6596abc08a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f28dea-1c91-4c86-88b4-554365281af2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11587f2-a064-41b9-ba03-7b7086b03e40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2118d164-599f-403f-bf2a-6e6cd66f26d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:17 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[79449b2e-55e2-4e8f-b026-9e6d9e46e0b0]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG os_brick.utils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:17 user nova-compute[75648]: INFO nova.compute.manager [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Swapping volume b2d32e57-63ef-4c98-ab17-cd43abad7bff for b2936138-c6dd-4cc9-9837-23b3ebc0218d
Nov 15 05:41:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-changed-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Refreshing instance network info cache due to event network-changed-4410ca77-8cc0-4991-bd20-063ee83e9ee7. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] Acquiring lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] Acquired lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Refreshing network info cache for port 4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG nova.objects.instance [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.142s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updated VIF entry in instance network info cache for port 4410ca77-8cc0-4991-bd20-063ee83e9ee7. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updating instance_info_cache with network_info: [{"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9008820c-09b2-4c1b-940d-e7dda9f94804 req-f83f6e55-cf4e-402c-abe4-64ee422ae75f service nova] Releasing lock "refresh_cache-5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:18 user nova-compute[75648]: INFO nova.compute.manager [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Attaching volume 3d870278-5de3-4433-b416-3e0e2eec6055 to /dev/vdb
Nov 15 05:41:18 user nova-compute[75648]: DEBUG os_brick.utils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38a47ff-c7ae-4faa-a678-372f8122762e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c255f737-416f-45ca-a816-3bb81c0a23f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ed247a-5da3-4684-9a48-b34fbe5c9b68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb746be-11c4-48a7-bc35-64191e5a2454]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:18 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8b5585-76b6-4232-8c62-b95a05221526]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG os_brick.utils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:18 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updating existing volume attachment record: 2cd1e21e-5044-4b90-ad82-9597948c712f {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:41:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqrQviNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38f6fbf6-3909-49d8-ab29-fb57a1727394', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'serial': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '38f6fbf6-3909-49d8-ab29-fb57a1727394', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'serial'} {{(pid=75648) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqrQviNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:22 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:22 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:22 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3960c75-3288-4539-b182-e2d86b534772]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:22 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d437748-00ee-4688-b504-649ad731e98e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d] added
Nov 15 05:41:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4185c0d8-6491-41b0-a0ab-eebe3020e7c2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b88ba07-b9e1-45d5-92ed-8251367cd5b1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqrQviNE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqrQviNE" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1767fd39-6c12-402f-a633-bcdbbd4cc262]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqrQviNE'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3ae583-157f-4ced-b39f-7c604344efc1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f2638-f3a0-4385-bca3-cd9d8f20de15]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7fdc8c-5d83-4bdc-9cec-4c1a4cf1b80e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260]
Nov 15 05:41:22 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee00436-7e15-47c5-a4bb-a6736a3d70b6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2a1a56-2398-4510-8041-091dda93ca1c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:22 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4128805-bc45-4bf8-af6b-bc419014827f]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:22 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqrQviNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] <== connect_volume: return (1354ms) {'type': 'block', 'scsi_wwn': '23033346664326363', 'path': '/dev/sdi'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033346664326363', 'path': '/dev/sdi'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lazy-loading 'flavor' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYTCMGjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:24 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:24 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:24 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2785613c-ebee-4d86-a4a8-6ce68900bf7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:24 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c32cf8-cc9e-47a1-bdc3-b50c32c095e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055] added
Nov 15 05:41:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 102760448 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d020c5d3-bf09-46ca-a609-d7a81ade94c6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adae30d-ed96-426a-b566-ef187552ee0b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYTCMGjq {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RYTCMGjq" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[660a8eb2-1043-42db-90e1-e8a92b923ac7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RYTCMGjq'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f2b12-3c5c-4890-a321-336040bdf0fd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6978067c-9dec-4bbd-964d-096d616191a3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[55cf4787-a75f-470e-b308-ea98fbc54d90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260]
Nov 15 05:41:24 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdec0e28-6198-42d2-ad38-adeff648dada]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23514c7e-4e4a-456e-8491-98af79932c31]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:24 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] HCTL ('41', '-', '-', 0) found on session 11 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[433dc34e-9307-438f-a0e0-3e056b6c1311]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 200278016 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 404750336 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Searching for a device in session 11 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYTCMGjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.421s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23765656336373963', 'path': '/dev/sdj'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765656336373963', 'path': '/dev/sdj'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG nova.objects.instance [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] attach device xml: <disk type="block" device="disk">
Nov 15 05:41:25 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:25 user nova-compute[75648]:   <source dev="/dev/sdj"/>
Nov 15 05:41:25 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:25 user nova-compute[75648]:   <serial>3d870278-5de3-4433-b416-3e0e2eec6055</serial>
Nov 15 05:41:25 user nova-compute[75648]: </disk>
Nov 15 05:41:25 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:41:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 605028352 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 748683264 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] No VIF found with MAC fa:16:3e:d1:2a:2b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:41:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-015376e7-58ba-406e-9c4b-08b60567e041 tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.984s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 873463808 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 1008730112 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] volume_snapshot_create: create_info: {'snapshot_id': '60defc1f-5352-486b-a574-37c7c633a807', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75648) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 15 05:41:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] snap xml: <domainsnapshot>
Nov 15 05:41:27 user nova-compute[75648]:   <disks>
Nov 15 05:41:27 user nova-compute[75648]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 15 05:41:27 user nova-compute[75648]:       <source file="/dev/new_file"/>
Nov 15 05:41:27 user nova-compute[75648]:     </disk>
Nov 15 05:41:27 user nova-compute[75648]:     <disk name="vda" snapshot="no"/>
Nov 15 05:41:27 user nova-compute[75648]:   </disks>
Nov 15 05:41:27 user nova-compute[75648]: </domainsnapshot>
Nov 15 05:41:27 user nova-compute[75648]:  {{(pid=75648) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 15 05:41:27 user nova-compute[75648]: DEBUG nova.objects.instance [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] Lazy-loading 'system_metadata' on Instance uuid 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:27 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     rv = execute(f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     six.reraise(c, e, tb)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     raise value
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     rv = meth(*args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     self._volume_snapshot_create(context, instance, guest,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     rv = execute(f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     six.reraise(c, e, tb)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     raise value
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     rv = meth(*args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] 
Nov 15 05:41:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a77db8c8-7f03-49ee-94bb-43e05427989b tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] volume_snapshot_delete: delete_info: {'volume_id': '3d870278-5de3-4433-b416-3e0e2eec6055'} {{(pid=75648) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [None req-a77db8c8-7f03-49ee-94bb-43e05427989b tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea]     if delete_info['type'] != 'qcow2':
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] KeyError: 'type'
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [None req-a77db8c8-7f03-49ee-94bb-43e05427989b tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-f8833fc7-49ff-416f-9754-131170dc312a)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 60defc1f-5352-486b-a574-37c7c633a807 could not be found.
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise value
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 60defc1f-5352-486b-a574-37c7c633a807 could not be found. (HTTP 404) (Request-ID: req-b3e03a1b-66a5-4d00-b788-f4363ba0a364)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 60defc1f-5352-486b-a574-37c7c633a807 could not be found.
Nov 15 05:41:27 user nova-compute[75648]: ERROR nova.virt.libvirt.driver 
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server [None req-7abb3838-5d51-40f3-b179-77b82ab9cc83 tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     raise value
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server 
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server [None req-a77db8c8-7f03-49ee-94bb-43e05427989b tempest-VolumesAssistedSnapshotsTest-1942507530 tempest-VolumesAssistedSnapshotsTest-1942507530-project] Exception during message handling: KeyError: 'type'
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 15 05:41:27 user nova-compute[75648]: ERROR oslo_messaging.rpc.server 
Nov 15 05:41:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:28 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: INFO nova.compute.manager [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Detaching volume 3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0633b4ca-de97-40e9-9ea1-1bd22afda89a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:28 user nova-compute[75648]: No targets found.
Nov 15 05:41:28 user nova-compute[75648]: iSNS:
Nov 15 05:41:28 user nova-compute[75648]: No targets found.
Nov 15 05:41:28 user nova-compute[75648]: STATIC:
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:28 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:28 user nova-compute[75648]: No targets found.
Nov 15 05:41:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:28 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:28 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa71869-89b0-42bc-b19b-e1890bee603f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: INFO nova.virt.block_device [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Attempting to driver detach volume 3d870278-5de3-4433-b416-3e0e2eec6055 from mountpoint /dev/vdb
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2496175b-dbca-4a81-a229-7d02415743b6]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:28 user nova-compute[75648]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47afeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff'): ({'sdh'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Removing single pathed devices sdh {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Attempting to detach device vdb from instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:28 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:28 user nova-compute[75648]:   <source dev="/dev/sdj"/>
Nov 15 05:41:28 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:28 user nova-compute[75648]:   <serial>3d870278-5de3-4433-b416-3e0e2eec6055</serial>
Nov 15 05:41:28 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:28 user nova-compute[75648]: </disk>
Nov 15 05:41:28 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Successfully detached device vdb from instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea from the persistent domain config.
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:28 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:28 user nova-compute[75648]:   <source dev="/dev/sdj"/>
Nov 15 05:41:28 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:28 user nova-compute[75648]:   <serial>3d870278-5de3-4433-b416-3e0e2eec6055</serial>
Nov 15 05:41:28 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:28 user nova-compute[75648]: </disk>
Nov 15 05:41:28 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d644057-ea6b-4569-83fe-75e16905439f]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[78796bf0-6200-4bd4-817c-8dfa87d2f9a0]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Flushing IO for device /dev/sdh {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bb1941-fa32-4bd7-af28-df5da0ad195f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.033s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fbe013-dc83-4bd6-900c-7642f34d83d2]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] SCSI volumes sdh have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf376b3a-bb5a-4fc7-a338-977240d59c35]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[195df2ed-9c60-466f-8a74-4eaa5100ff26]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]
Nov 15 05:41:28 user nova-compute[75648]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b6499f-c96b-4a30-8526-10fb24234ab2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] <== disconnect_volume: return (322ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqrQviNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '38f6fbf6-3909-49d8-ab29-fb57a1727394', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'serial'} {{(pid=75648) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] swap_volume: removing Cinder connection for volume b2d32e57-63ef-4c98-ab17-cd43abad7bff {{(pid=75648) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 05:41:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:41:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] swap_volume: Updating volume b2d32e57-63ef-4c98-ab17-cd43abad7bff BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bqrQviNE", "auth_password": "fuMos2dbxA4ZH9", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "b2936138-c6dd-4cc9-9837-23b3ebc0218d"}, "status": "reserved", "instance": "38f6fbf6-3909-49d8-ab29-fb57a1727394", "attached_at": "", "detached_at": "", "volume_id": "b2936138-c6dd-4cc9-9837-23b3ebc0218d", "serial": "b2936138-c6dd-4cc9-9837-23b3ebc0218d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'no_device': None, 'attachment_id': '434a5d8f-66eb-4e59-b66c-a44d03ed2aa8'} {{(pid=75648) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 05:41:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ed63c057-c60f-477d-8b8c-dc0409ac43d4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.160s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG os_brick.utils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a9b54d-4685-46ab-8719-98b35166916e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a46542-eb35-42d2-b32b-eb45d9b1f885]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3750009-d714-455c-bd98-20cee1030cc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79ab42d-86aa-40d8-bab0-418d9bca4b5c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:30 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7de390-8922-43c4-b9a2-20d23e5e5b21]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:30 user nova-compute[75648]: DEBUG os_brick.utils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:30 user nova-compute[75648]: INFO nova.compute.manager [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Swapping volume b2936138-c6dd-4cc9-9837-23b3ebc0218d for b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:33 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance bd28591c-ff83-40f9-8298-9fab5de1dcbc is timed out.
Nov 15 05:41:33 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Successfully detached device sdc from instance bd28591c-ff83-40f9-8298-9fab5de1dcbc from the live domain config.
Nov 15 05:41:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKNxaUBd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:33 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f939343-a47e-4a44-9b01-614b7752c8c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:33 user nova-compute[75648]: No targets found.
Nov 15 05:41:33 user nova-compute[75648]: iSNS:
Nov 15 05:41:33 user nova-compute[75648]: No targets found.
Nov 15 05:41:33 user nova-compute[75648]: STATIC:
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:33 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:33 user nova-compute[75648]: No targets found.
Nov 15 05:41:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:33 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:33 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[73896862-8417-478d-82cf-9a062d868b75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e05800-4a18-49d6-bc86-8fcc6d872392]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ad1b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9'): ({'sdf'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Removing single pathed devices sdf {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfedd2f3-f3b4-4470-a2a5-9c70224401a2]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[669ec168-777d-4787-aa2c-b89f87f9b989]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Flushing IO for device /dev/sdf {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.011s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b7ff28-ee3b-4dda-83d1-153a74e0362d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0cf3ac-0c30-42fc-9024-77dcfba7d37b]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d88cc7d-d41c-4b92-ae5c-4aa02f718c7f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d74ddf3-5063-4df9-ba33-8ecd0ef894e4]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260]
Nov 15 05:41:34 user nova-compute[75648]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:34 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d25b4feb-9a18-4e44-bb1b-0896221c4ef9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3fca4a-71f4-4151-afe6-1b22223c7991]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] <== disconnect_volume: return (330ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lazy-loading 'flavor' on Instance uuid bd28591c-ff83-40f9-8298-9fab5de1dcbc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-59b9176d-e340-4057-afe8-582da8cb2c38 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.067s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:35 user nova-compute[75648]: INFO nova.compute.manager [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Terminating instance
Nov 15 05:41:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38f6fbf6-3909-49d8-ab29-fb57a1727394', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'serial': 'b2d32e57-63ef-4c98-ab17-cd43abad7bff'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqrQviNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d'}, 'status': 'reserved', 'instance': '38f6fbf6-3909-49d8-ab29-fb57a1727394', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'serial'} {{(pid=75648) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:35 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:35 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:35 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c19180-43c1-4e42-9e5a-e9fa51d094da]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:35 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a894c3-4e72-4b76-a297-75c2530b4ec9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff] added
Nov 15 05:41:35 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-d6ad36df-ec6e-4685-995e-15928192ad88 req-a3048412-e7f7-45a6-b194-95cb85022900 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-vif-unplugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d6ad36df-ec6e-4685-995e-15928192ad88 req-a3048412-e7f7-45a6-b194-95cb85022900 service nova] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d6ad36df-ec6e-4685-995e-15928192ad88 req-a3048412-e7f7-45a6-b194-95cb85022900 service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d6ad36df-ec6e-4685-995e-15928192ad88 req-a3048412-e7f7-45a6-b194-95cb85022900 service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-d6ad36df-ec6e-4685-995e-15928192ad88 req-a3048412-e7f7-45a6-b194-95cb85022900 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] No waiting events found dispatching network-vif-unplugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-d6ad36df-ec6e-4685-995e-15928192ad88 req-a3048412-e7f7-45a6-b194-95cb85022900 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-vif-unplugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1144c-6445-467f-a28b-4e599c08dba1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[349e0b74-cbbb-433c-b6d1-2abcdc20271b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbUXZLcw {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mbUXZLcw" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e0711-98eb-46c8-bac6-ba60982543b1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mbUXZLcw'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be8fdb4-3c6c-413b-85c7-bab685f4560d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a1ac3-1743-43dc-ac84-d8d7fa62f1bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a55709-bdeb-461f-9af7-f22a26e4c144]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]
Nov 15 05:41:36 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d911c98-c9ba-4f55-90a1-e2f65ad8fcf2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e71bc37-c8a5-4115-b254-4bc79c9b4bb0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:36 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[42958f11-5557-4b00-a8cf-07e5a4aefa62]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Instance destroyed successfully.
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.objects.instance [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lazy-loading 'resources' on Instance uuid bd28591c-ff83-40f9-8298-9fab5de1dcbc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1125550578',display_name='tempest-AttachSCSIVolumeTestJSON-server-1125550578',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1125550578',id=7,image_ref='a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9Uqs25zaPUim1UtW2dDyekFU3sRvb7nskxGtLxOchgJOPI1skGIpL7SrQZcN5gcZwhNXaA+RmzXlnBfZMNuIBxQ65cSuac9zP5GE0yVa2XwbUCUUMKfOlGMk+B2Q+vVA==',key_name='tempest-keypair-537088292',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='56d3b3cc220e400b9fd1e1d73d313159',ramdisk_id='',reservation_id='r-5426zyu2',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9cf7093-8c57-4a0f-aba0-bb4b689bf8ac',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-439021849',owner_user_name='tempest-AttachSCSIVolumeTestJSON-439021849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd1cdbd2b9ea45099db6d6f2737b3a00',uuid=bd28591c-ff83-40f9-8298-9fab5de1dcbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Converting VIF {"id": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "address": "fa:16:3e:31:15:86", "network": {"id": "e9c11b6d-4273-4849-a2a3-aeb53b1cf294", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-976688405-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "56d3b3cc220e400b9fd1e1d73d313159", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd90f49d6-d3", "ovs_interfaceid": "d90f49d6-d3f5-4220-ae8d-13d52f62216f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_vif [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd90f49d6-d3, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6153086-1a8c-4f69-9687-31dd2b08bf50) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:36 user nova-compute[75648]: INFO os_vif [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:15:86,bridge_name='br-int',has_traffic_filtering=True,id=d90f49d6-d3f5-4220-ae8d-13d52f62216f,network=Network(e9c11b6d-4273-4849-a2a3-aeb53b1cf294),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd90f49d6-d3')
Nov 15 05:41:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Deleting instance files /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc_del
Nov 15 05:41:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Deletion of /opt/stack/data/nova/instances/bd28591c-ff83-40f9-8298-9fab5de1dcbc_del complete
Nov 15 05:41:36 user nova-compute[75648]: INFO nova.compute.manager [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 05:41:36 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:41:36 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c is timed out.
Nov 15 05:41:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Successfully detached device vdb from instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c from the live domain config.
Nov 15 05:41:36 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LvRjBKzW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:36 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '23063653232303863', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063653232303863', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.386s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lazy-loading 'flavor' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-19dfec66-defe-4b45-a05b-528b8d3b560a req-df38702e-962b-4d2f-a4c4-7a0700edf6af service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-vif-deleted-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:37 user nova-compute[75648]: INFO nova.compute.manager [req-19dfec66-defe-4b45-a05b-528b8d3b560a req-df38702e-962b-4d2f-a4c4-7a0700edf6af service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Neutron deleted interface d90f49d6-d3f5-4220-ae8d-13d52f62216f; detaching it from the instance and deleting it from the info cache
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-19dfec66-defe-4b45-a05b-528b8d3b560a req-df38702e-962b-4d2f-a4c4-7a0700edf6af service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[560e2dd8-60a8-46ec-af2b-255d7807c1bc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Took 0.83 seconds to deallocate network for instance.
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:37 user nova-compute[75648]: No targets found.
Nov 15 05:41:37 user nova-compute[75648]: iSNS:
Nov 15 05:41:37 user nova-compute[75648]: No targets found.
Nov 15 05:41:37 user nova-compute[75648]: STATIC:
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:37 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:37 user nova-compute[75648]: No targets found.
Nov 15 05:41:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:37 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:37 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-19dfec66-defe-4b45-a05b-528b8d3b560a req-df38702e-962b-4d2f-a4c4-7a0700edf6af service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Detach interface failed, port_id=d90f49d6-d3f5-4220-ae8d-13d52f62216f, reason: Instance bd28591c-ff83-40f9-8298-9fab5de1dcbc could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ada136-cfec-4613-a405-72452eea5db5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a4f431-1339-411f-ba3b-2a9850ba2cf1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:37 user nova-compute[75648]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 (non-flash)
Nov 15 05:41:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e86b7250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511'): ({'sdg'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Removing single pathed devices sdg {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7089e7eb-51b5-4dd1-8c07-fbfaf58df3f6]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[98750736-bd8a-4acc-bbb7-031bd9f7e856]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Flushing IO for device /dev/sdg {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f084ad78-b833-454b-bf70-e971d570627d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91c969e-a7e1-4d5f-8123-599e7e177af8]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a23ef6-a4df-46c7-be9f-58e961b45776]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-changed-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Refreshing instance network info cache due to event network-changed-dbb125a4-be50-4777-baec-60fe0ec9e534. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] Acquiring lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] Acquired lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Refreshing network info cache for port dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd1278a-4560-4215-9ca4-035c37898b45]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260]
Nov 15 05:41:37 user nova-compute[75648]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4a815f5-fb26-4148-ac42-99699035f511 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca8ea1-5870-4382-82b4-c23545bf6730]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] <== disconnect_volume: return (736ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:41:37 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.587s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'flavor' on Instance uuid 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-91aab1f8-1f15-42fe-862f-c9b4c5dde77e req-e945fe55-6bce-4354-871e-7b7138c129f9 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received event network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-91aab1f8-1f15-42fe-862f-c9b4c5dde77e req-e945fe55-6bce-4354-871e-7b7138c129f9 service nova] Acquiring lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-91aab1f8-1f15-42fe-862f-c9b4c5dde77e req-e945fe55-6bce-4354-871e-7b7138c129f9 service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-91aab1f8-1f15-42fe-862f-c9b4c5dde77e req-e945fe55-6bce-4354-871e-7b7138c129f9 service nova] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-91aab1f8-1f15-42fe-862f-c9b4c5dde77e req-e945fe55-6bce-4354-871e-7b7138c129f9 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] No waiting events found dispatching network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:38 user nova-compute[75648]: WARNING nova.compute.manager [req-91aab1f8-1f15-42fe-862f-c9b4c5dde77e req-e945fe55-6bce-4354-871e-7b7138c129f9 service nova] [instance: bd28591c-ff83-40f9-8298-9fab5de1dcbc] Received unexpected event network-vif-plugged-d90f49d6-d3f5-4220-ae8d-13d52f62216f for instance with vm_state deleted and task_state None.
Nov 15 05:41:38 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Deleted allocations for instance bd28591c-ff83-40f9-8298-9fab5de1dcbc
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.network.neutron [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updated VIF entry in instance network info cache for port dbb125a4-be50-4777-baec-60fe0ec9e534. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.network.neutron [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating instance_info_cache with network_info: [{"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7daea251-2668-42b6-8d57-3a32c445273d req-5d67c501-8260-4704-873f-b1547b26c200 service nova] Releasing lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7294a26c-b626-443c-9d21-5f36bc32ab26 tempest-AttachSCSIVolumeTestJSON-439021849 tempest-AttachSCSIVolumeTestJSON-439021849-project-member] Lock "bd28591c-ff83-40f9-8298-9fab5de1dcbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.509s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:38 user nova-compute[75648]: INFO nova.compute.manager [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Attaching volume f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 to /dev/vdb
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 37748736 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd1023-2337-4077-bc56-fb6f22e6e1d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a25467-186c-4511-b5d5-dab8f71856ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a992749b-3ebd-41e1-8f5d-728d4bac4a65]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8ec2bd-1853-4184-b54e-dae528140e7d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:38 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[24734a33-deb8-4162-b6b3-da9d116f4cb4]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG os_brick.utils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] <== get_connector_properties: return (104ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating existing volume attachment record: c92227f7-5fad-45d0-839b-32fe4c33b91b {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:41:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 38797312 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 53477376 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 83886080 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:39 user nova-compute[75648]: DEBUG nova.objects.instance [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'flavor' on Instance uuid 177ad35a-a9fc-4c31-89d5-2592bb24bb4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dbf41296-dc26-47c7-959d-9b504dc82aec tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.582s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 266338304 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 437256192 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 621805568 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-changed-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing instance network info cache due to event network-changed-7b20824a-3150-43fc-8188-4ebbc0e11d4c. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] Acquiring lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] Acquired lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Refreshing network info cache for port 7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 916455424 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updated VIF entry in instance network info cache for port 7b20824a-3150-43fc-8188-4ebbc0e11d4c. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-05048ef4-22c0-4580-95d4-545bf958843a req-e0de3e4e-760f-466c-8d0d-df776908b723 service nova] Releasing lock "refresh_cache-9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 1000341504 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqrQviNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'b2936138-c6dd-4cc9-9837-23b3ebc0218d'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec7985c-95b2-486c-be57-a61181d69aa4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:43 user nova-compute[75648]: No targets found.
Nov 15 05:41:43 user nova-compute[75648]: iSNS:
Nov 15 05:41:43 user nova-compute[75648]: No targets found.
Nov 15 05:41:43 user nova-compute[75648]: STATIC:
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:43 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:43 user nova-compute[75648]: No targets found.
Nov 15 05:41:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:43 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:43 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc3cbc5-7526-47c7-afa0-582e3281eb44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a8dd1-6917-4508-bb8f-1b152723315e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:43 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8158dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d'): ({'sdi'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Removing single pathed devices sdi {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b774076-c82c-41a8-82fe-d3247e3c6211]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b7f204-3472-4c35-96c5-d654aa428552]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Flushing IO for device /dev/sdi {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[543e4470-6c0a-4590-9e04-078ae116ee3c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f992ce99-a052-433c-88be-1810df3ab1a7]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] SCSI volumes sdi have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d69d958-4919-4ed2-ba93-ed15aea9a651]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b085787-04f9-4dc3-9435-7cc88840333f]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260]
Nov 15 05:41:43 user nova-compute[75648]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2936138-c6dd-4cc9-9837-23b3ebc0218d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5b10fe-945e-4fe3-8708-5eca589854ce]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] <== disconnect_volume: return (311ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '38f6fbf6-3909-49d8-ab29-fb57a1727394', 'attached_at': '', 'detached_at': '', 'volume_id': 'b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'serial'} {{(pid=75648) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 15 05:41:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] swap_volume: removing Cinder connection for volume b2936138-c6dd-4cc9-9837-23b3ebc0218d {{(pid=75648) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:44 user nova-compute[75648]: INFO nova.compute.manager [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Terminating instance
Nov 15 05:41:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUgHnSFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:44 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:44 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:44 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[857d5ca2-9375-4d04-9a2b-ac88363d63f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:41:44 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3451e2-87dc-496f-b0b7-e39b255107ed]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23] added
Nov 15 05:41:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e25d78-e68b-480e-b087-30a0d04016c3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ec9300-f89a-4f2f-bad2-3eea43d532e6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUgHnSFo {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uUgHnSFo" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecec0a4-1071-47dc-9ae4-28e0a612950f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uUgHnSFo'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9954d0d9-3256-42cb-838d-456499362b88]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-916d97d8-9fd3-488b-af34-dd9a152fc3a3 req-af9d52f3-db78-4d2a-baa8-26681f9a1814 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-916d97d8-9fd3-488b-af34-dd9a152fc3a3 req-af9d52f3-db78-4d2a-baa8-26681f9a1814 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-916d97d8-9fd3-488b-af34-dd9a152fc3a3 req-af9d52f3-db78-4d2a-baa8-26681f9a1814 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-916d97d8-9fd3-488b-af34-dd9a152fc3a3 req-af9d52f3-db78-4d2a-baa8-26681f9a1814 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-916d97d8-9fd3-488b-af34-dd9a152fc3a3 req-af9d52f3-db78-4d2a-baa8-26681f9a1814 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-916d97d8-9fd3-488b-af34-dd9a152fc3a3 req-af9d52f3-db78-4d2a-baa8-26681f9a1814 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df7581d-76a7-412d-978b-54483eca752b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[96771c9b-afb8-4f32-b97d-37d7b6dda714]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260]
Nov 15 05:41:44 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] swap_volume: Updating volume b2936138-c6dd-4cc9-9837-23b3ebc0218d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "mbUXZLcw", "auth_password": "C6MDaQY0Fv2KOg", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "b2d32e57-63ef-4c98-ab17-cd43abad7bff"}, "status": "reserved", "instance": "38f6fbf6-3909-49d8-ab29-fb57a1727394", "attached_at": "", "detached_at": "", "volume_id": "b2d32e57-63ef-4c98-ab17-cd43abad7bff", "serial": "b2d32e57-63ef-4c98-ab17-cd43abad7bff"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'no_device': None, 'attachment_id': 'fd63f6a9-9bcf-4450-8dce-38ef58b432e5'} {{(pid=75648) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.037s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd05eef-c6dd-463e-bc46-9715d6ebe4ff]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5c30e3d0-017c-46d1-935b-8023e88fc9b4 tempest-TestVolumeSwap-1719994674 tempest-TestVolumeSwap-1719994674-project-admin] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.081s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c59ed-9181-42ad-80f9-d300f436bea5]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:44 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] HCTL ('38', '-', '-', 0) found on session 13 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bffc22-c519-4e4b-9b06-0f5142feb515]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Searching for a device in session 13 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUgHnSFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-08db39c7-96c0-4216-9c33-6b640e749266 req-9848b06b-abdd-4419-ae22-94cc0c80faba service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-08db39c7-96c0-4216-9c33-6b640e749266 req-9848b06b-abdd-4419-ae22-94cc0c80faba service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-08db39c7-96c0-4216-9c33-6b640e749266 req-9848b06b-abdd-4419-ae22-94cc0c80faba service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-08db39c7-96c0-4216-9c33-6b640e749266 req-9848b06b-abdd-4419-ae22-94cc0c80faba service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-08db39c7-96c0-4216-9c33-6b640e749266 req-9848b06b-abdd-4419-ae22-94cc0c80faba service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-08db39c7-96c0-4216-9c33-6b640e749266 req-9848b06b-abdd-4419-ae22-94cc0c80faba service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-74ff529b-38db-4002-b259-f8bcf989ba68 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: INFO nova.compute.manager [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Detaching volume b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:45 user nova-compute[75648]: INFO nova.virt.block_device [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Attempting to driver detach volume b2d32e57-63ef-4c98-ab17-cd43abad7bff from mountpoint /dev/vdb
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Attempting to detach device vdb from instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:45 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:45 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:41:45 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:45 user nova-compute[75648]:   <serial>b2d32e57-63ef-4c98-ab17-cd43abad7bff</serial>
Nov 15 05:41:45 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:45 user nova-compute[75648]: </disk>
Nov 15 05:41:45 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Successfully detached device vdb from instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 from the persistent domain config.
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:45 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:45 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:41:45 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:45 user nova-compute[75648]:   <serial>b2d32e57-63ef-4c98-ab17-cd43abad7bff</serial>
Nov 15 05:41:45 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:45 user nova-compute[75648]: </disk>
Nov 15 05:41:45 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '26434653166393136', 'path': '/dev/sdg'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26434653166393136', 'path': '/dev/sdg'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'flavor' on Instance uuid 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:41:45 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:45 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:41:45 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:45 user nova-compute[75648]:   <serial>f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23</serial>
Nov 15 05:41:45 user nova-compute[75648]: </disk>
Nov 15 05:41:45 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:41:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Instance destroyed successfully.
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.objects.instance [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lazy-loading 'resources' on Instance uuid 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b20824a-31, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=364244b8-6fe0-4b34-a9c3-2f1bd527da27) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:74:42,bridge_name='br-int',has_traffic_filtering=True,id=7b20824a-3150-43fc-8188-4ebbc0e11d4c,network=Network(0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b20824a-31')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapab297d47-f9, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3c18b83-5ef4-4e9c-86fd-48351428ad61) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:46:61,bridge_name='br-int',has_traffic_filtering=True,id=ab297d47-f95b-4ed9-b0c5-50b11c98db33,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapab297d47-f9')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa3f16d9-66, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1765b66-b600-46b3-a9f2-1ed9e770ce8d) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:ab:35,bridge_name='br-int',has_traffic_filtering=True,id=fa3f16d9-6690-47ee-8f1c-ad5089782975,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfa3f16d9-66')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74ff529b-38, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3718ebe0-1e3b-4075-9302-833c0d44b507) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No VIF found with MAC fa:16:3e:36:c5:e6, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a0:10:ee,bridge_name='br-int',has_traffic_filtering=True,id=74ff529b-38db-4002-b259-f8bcf989ba68,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74ff529b-38')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa51ac001-f7, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1d076a9-4818-4e23-bbd9-be9f3642a987) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:09:20,bridge_name='br-int',has_traffic_filtering=True,id=a51ac001-f74d-46c5-b283-ff918f27ed1b,network=Network(32c03cff-5122-44c6-8e62-2bfdcb0b52b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa51ac001-f7')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap623b99f1-a3, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: WARNING nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-7b20824a-3150-43fc-8188-4ebbc0e11d4c for instance with vm_state active and task_state deleting.
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: WARNING nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-ab297d47-f95b-4ed9-b0c5-50b11c98db33 for instance with vm_state active and task_state deleting.
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: WARNING nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-fa3f16d9-6690-47ee-8f1c-ad5089782975 for instance with vm_state active and task_state deleting.
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-4fb6a740-625e-4720-9404-e97f8b46e5fd for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:46 user nova-compute[75648]: WARNING nova.compute.manager [req-678fc092-afd6-4b8c-bbc2-1a6acc12860b req-8a5d31ec-65e8-4c1c-87e5-73d05bba94f6 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-4fb6a740-625e-4720-9404-e97f8b46e5fd for instance with vm_state active and task_state deleting.
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0748955-58f5-4645-8961-f6e25aebe44b) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d8188a05-95d7-4984-b5b3-008b0f82eb4c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.542s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:36:66,bridge_name='br-int',has_traffic_filtering=True,id=623b99f1-a342-4767-8189-2e883a779a3f,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap623b99f1-a3')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:39:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1029037045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1029037045',id=12,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3M/ZtSzNca213YUtJODUoeJHl+80nMerDVxj01GO0hy5AQe/9zVyXl+jP2V9mHQ43BFZF3nbXbfSjZaxpIXtnrDIkq/YpgCMVjSEU7XcdZb9bz+L+B8z8qlFDzLaayQA==',key_name='tempest-keypair-1383090751',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d553191c88e43b6a3c1f19f88b72913',ramdisk_id='',reservation_id='r-phcqlfdy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1891485400',owner_user_name='tempest-TaggedBootDevicesTest_v242-1891485400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1026e52571e4bbbb7416ccab6256bd4',uuid=9bf56e1c-854a-4d47-8569-c71d2c6cc8c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converting VIF {"id": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "address": "fa:16:3e:e8:92:18", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4fb6a740-62", "ovs_interfaceid": "4fb6a740-625e-4720-9404-e97f8b46e5fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4fb6a740-62, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45cc3a52-e826-48f6-ae95-7c554b6b6d1e) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:41:46 user nova-compute[75648]: INFO os_vif [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:92:18,bridge_name='br-int',has_traffic_filtering=True,id=4fb6a740-625e-4720-9404-e97f8b46e5fd,network=Network(9efe4d7c-590c-4a0f-8b9c-aa9589750950),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4fb6a740-62')
Nov 15 05:41:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hVtkwXrZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:46 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ca53f8-5d9d-40a1-b728-64991d8ab6d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:46 user nova-compute[75648]: No targets found.
Nov 15 05:41:46 user nova-compute[75648]: iSNS:
Nov 15 05:41:46 user nova-compute[75648]: No targets found.
Nov 15 05:41:46 user nova-compute[75648]: STATIC:
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:46 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:46 user nova-compute[75648]: No targets found.
Nov 15 05:41:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:46 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:46 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5b8506-62de-42d9-a421-132570e9b763]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48fdd81-09ed-401e-90c4-af8d031f45e3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:46 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9fdd12560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aac0c46-f08f-475a-86e1-7fa5e4449fd2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3665f0ea-c9f8-4c52-8607-c65fc162bb1b]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[537ea584-53f5-4d76-b0a9-fdb7160d2817]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db48ada-05ed-40a3-9c0f-4d3d2b44a17a]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[670af5d4-0ee3-487e-a803-e27fe31606c3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:47 user nova-compute[75648]: WARNING nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-74ff529b-38db-4002-b259-f8bcf989ba68 for instance with vm_state active and task_state deleting.
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-a51ac001-f74d-46c5-b283-ff918f27ed1b for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:47 user nova-compute[75648]: WARNING nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-a51ac001-f74d-46c5-b283-ff918f27ed1b for instance with vm_state active and task_state deleting.
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-unplugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-unplugged-623b99f1-a342-4767-8189-2e883a779a3f for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Acquiring lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] No waiting events found dispatching network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:41:47 user nova-compute[75648]: WARNING nova.compute.manager [req-1d49777d-ca71-4115-98d3-6c1702dd9b22 req-d1eb8a08-1db3-44f5-9ec2-c2b3d4be6298 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received unexpected event network-vif-plugged-623b99f1-a342-4767-8189-2e883a779a3f for instance with vm_state active and task_state deleting.
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f26b85d-f3a0-4693-bb31-b86db2d0f1cd]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260]
Nov 15 05:41:47 user nova-compute[75648]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4707ad88-91f2-4f67-8b89-dc51ffa100f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bedde0d-ad4f-4851-bc50-4664c61c9b6c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== disconnect_volume: return (377ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tnNeoXAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:47 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8c59fc-f854-4e4f-8092-76e7e09808f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:47 user nova-compute[75648]: No targets found.
Nov 15 05:41:47 user nova-compute[75648]: iSNS:
Nov 15 05:41:47 user nova-compute[75648]: No targets found.
Nov 15 05:41:47 user nova-compute[75648]: STATIC:
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:47 user nova-compute[75648]: No targets found.
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:47 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:47 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8163fd-11f3-4954-9023-fc7f1c253b94]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[032f3cfe-5769-45e8-bd8b-a61f11bec5ec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e84f1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bff75ed-a47c-42dd-a76e-536fd5bde936]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6411ce1c-83bd-4101-961c-8a858a2a5637]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f83def-d785-4b63-9eab-de9b16638ef8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e835ac8e-5d16-4041-9959-256e48c94929]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca06f802-b3f0-46e3-b18e-47f9d3e5278f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dabbb4d-47d5-4cf4-b480-89fda51548c5]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260]
Nov 15 05:41:47 user nova-compute[75648]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8020953-48b2-45fd-a09f-d491403d8832 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff2ee79-5b70-499e-8599-8a13b02a82d5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.369s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== disconnect_volume: return (371ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eViNUwyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:47 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2718e609-3493-4e45-bc56-9d8695c9a642]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:47 user nova-compute[75648]: No targets found.
Nov 15 05:41:47 user nova-compute[75648]: iSNS:
Nov 15 05:41:47 user nova-compute[75648]: No targets found.
Nov 15 05:41:47 user nova-compute[75648]: STATIC:
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249
Nov 15 05:41:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:47 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:47 user nova-compute[75648]: No targets found.
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:47 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:47 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[671a0c42-aa5d-44f4-bcf3-c148f3ee6632]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab8465-b2d0-4c63-81da-6fd9e41f9f33]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 (non-flash)
Nov 15 05:41:47 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e84f1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25669e80-a211-499a-aae0-5ca18e926735]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[53aab155-51fe-494f-9f61-a75353e69ae5]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee75e284-c786-4e2b-983a-4ad592f22a4a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad8f152-5c6c-40b1-9517-b8c064f47249]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c9bb85-8bb2-43dc-9dc3-8ac007b399c6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d134be0a-ac60-45d2-9791-de1e2de34472]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260]
Nov 15 05:41:48 user nova-compute[75648]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cbf61be1-6861-4cb2-b8c7-d0469ba59249 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[44dd627c-084f-4896-9647-d18dad98e734]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.389s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] <== disconnect_volume: return (391ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Deleting instance files /opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1_del
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Deletion of /opt/stack/data/nova/instances/9bf56e1c-854a-4d47-8569-c71d2c6cc8c1_del complete
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.compute.manager [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Took 3.82 seconds to destroy the instance on the hypervisor.
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea is timed out.
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Successfully detached device vdb from instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea from the live domain config.
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RYTCMGjq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:48 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[412082d5-8bf0-47f8-bbfe-dec327d2bc09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:41:48 user nova-compute[75648]: No targets found.
Nov 15 05:41:48 user nova-compute[75648]: iSNS:
Nov 15 05:41:48 user nova-compute[75648]: No targets found.
Nov 15 05:41:48 user nova-compute[75648]: STATIC:
Nov 15 05:41:48 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:41:48 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:48 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:48 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:41:48 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:48 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:48 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:41:48 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:48 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:48 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055
Nov 15 05:41:48 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:41:48 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:41:48 user nova-compute[75648]: FIRMWARE:
Nov 15 05:41:48 user nova-compute[75648]: No targets found.
Nov 15 05:41:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:41:48 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:41:48 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[258dd1de-fda1-4a5e-8a51-3131e9342558]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e596e80-e4eb-4f57-8786-a74d44cc8ae9]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:48 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:48 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:48 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 (non-flash)
Nov 15 05:41:48 user nova-compute[75648]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:41:48 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:41:48 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:41:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ae7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055'): ({'sdj'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Removing single pathed devices sdj {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.compute.manager [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Detaching volume f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[398bca97-cecb-4198-85ee-932f541a8fc5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b482ec-b00b-4bc4-bf36-30dbbc7484fa]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Flushing IO for device /dev/sdj {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2569a8b9-d8da-419d-84af-cd1961af389d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.virt.block_device [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Attempting to driver detach volume f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 from mountpoint /dev/vdb
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Attempting to detach device vdb from instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:48 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:48 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:41:48 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:48 user nova-compute[75648]:   <serial>f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23</serial>
Nov 15 05:41:48 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:48 user nova-compute[75648]: </disk>
Nov 15 05:41:48 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully detached device vdb from instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 from the persistent domain config.
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:41:48 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:41:48 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:41:48 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:41:48 user nova-compute[75648]:   <serial>f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23</serial>
Nov 15 05:41:48 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:41:48 user nova-compute[75648]: </disk>
Nov 15 05:41:48 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c63b72-7fba-404c-a7f0-95dd05cb4c4f]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] SCSI volumes sdj have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:41:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f58bea5-3b46-4190-adeb-c56b8d4ad4d8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a48a75e-6da3-451c-9443-67a59cc5c21d]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260]
Nov 15 05:41:49 user nova-compute[75648]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055, portal: 172.16.0.220,3260] successful.
Nov 15 05:41:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d870278-5de3-4433-b416-3e0e2eec6055 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[119bda04-876d-4029-af1b-483fea5e69b8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.453s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] <== disconnect_volume: return (455ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:41:49 user nova-compute[75648]: INFO nova.compute.claims [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Claim successful on node user
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Error from libvirt while getting description of instance-0000000c: [Error Code 42] Domain not found: no domain with matching uuid '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1' (instance-0000000c): libvirt.libvirtError: Domain not found: no domain with matching uuid '9bf56e1c-854a-4d47-8569-c71d2c6cc8c1' (instance-0000000c)
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lazy-loading 'flavor' on Instance uuid 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d07bdfbe-93bd-4eb7-bd17-9ae6f0fd28ce tempest-VolumesAssistedSnapshotsTest-651624304 tempest-VolumesAssistedSnapshotsTest-651624304-project-admin] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.011s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-04965159-16a3-4f24-a55d-4d6aed5865a5 req-09636277-b010-4de7-b582-c523f8e61203 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-deleted-4fb6a740-625e-4720-9404-e97f8b46e5fd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:50 user nova-compute[75648]: INFO nova.compute.manager [req-04965159-16a3-4f24-a55d-4d6aed5865a5 req-09636277-b010-4de7-b582-c523f8e61203 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Neutron deleted interface 4fb6a740-625e-4720-9404-e97f8b46e5fd; detaching it from the instance and deleting it from the info cache
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.network.neutron [req-04965159-16a3-4f24-a55d-4d6aed5865a5 req-09636277-b010-4de7-b582-c523f8e61203 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "623b99f1-a342-4767-8189-2e883a779a3f", "address": "fa:16:3e:29:36:66", "network": {"id": "9efe4d7c-590c-4a0f-8b9c-aa9589750950", "bridge": "br-int", "label": "tempest-device-tagging-net2-861775895", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap623b99f1-a3", "ovs_interfaceid": "623b99f1-a342-4767-8189-2e883a779a3f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-04965159-16a3-4f24-a55d-4d6aed5865a5 req-09636277-b010-4de7-b582-c523f8e61203 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Detach interface failed, port_id=4fb6a740-625e-4720-9404-e97f8b46e5fd, reason: Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.733s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:41:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.policy [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47b4817a59584433a28790c3a16d0b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13f9a55b45f4f9992e2f86628b34982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:41:50 user nova-compute[75648]: INFO nova.virt.block_device [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Booting with blank volume at /dev/vda
Nov 15 05:41:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:41:51 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:41:51 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7329MB free_disk=25.474021911621094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Successfully created port: 6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f2657470-018b-4c83-a7d2-4433401a7e17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.541s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Successfully updated port: 6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-changed-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Refreshing instance network info cache due to event network-changed-6472c753-29dc-40b6-be7a-761e5596244a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] Acquiring lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:41:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance network_info: |[{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] Acquired lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Refreshing network info cache for port 6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-deleted-623b99f1-a342-4767-8189-2e883a779a3f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:52 user nova-compute[75648]: INFO nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Neutron deleted interface 623b99f1-a342-4767-8189-2e883a779a3f; detaching it from the instance and deleting it from the info cache
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "address": "fa:16:3e:ac:09:20", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.162", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa51ac001-f7", "ovs_interfaceid": "a51ac001-f74d-46c5-b283-ff918f27ed1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Detach interface failed, port_id=623b99f1-a342-4767-8189-2e883a779a3f, reason: Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-deleted-a51ac001-f74d-46c5-b283-ff918f27ed1b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:52 user nova-compute[75648]: INFO nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Neutron deleted interface a51ac001-f74d-46c5-b283-ff918f27ed1b; detaching it from the instance and deleting it from the info cache
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "74ff529b-38db-4002-b259-f8bcf989ba68", "address": "fa:16:3e:a0:10:ee", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.39", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74ff529b-38", "ovs_interfaceid": "74ff529b-38db-4002-b259-f8bcf989ba68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Detach interface failed, port_id=a51ac001-f74d-46c5-b283-ff918f27ed1b, reason: Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-deleted-74ff529b-38db-4002-b259-f8bcf989ba68 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:52 user nova-compute[75648]: INFO nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Neutron deleted interface 74ff529b-38db-4002-b259-f8bcf989ba68; detaching it from the instance and deleting it from the info cache
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [{"id": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "address": "fa:16:3e:6a:74:42", "network": {"id": "0ee72b15-2e2f-45e9-ac4b-e2e9b5a55770", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1077712421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b20824a-31", "ovs_interfaceid": "7b20824a-3150-43fc-8188-4ebbc0e11d4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "address": "fa:16:3e:01:46:61", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.137", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapab297d47-f9", "ovs_interfaceid": "ab297d47-f95b-4ed9-b0c5-50b11c98db33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "address": "fa:16:3e:43:ab:35", "network": {"id": "32c03cff-5122-44c6-8e62-2bfdcb0b52b8", "bridge": "br-int", "label": "tempest-device-tagging-net1-916516278", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.186", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "1d553191c88e43b6a3c1f19f88b72913", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa3f16d9-66", "ovs_interfaceid": "fa3f16d9-6690-47ee-8f1c-ad5089782975", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-b236cf30-a9da-4f0e-873f-d666b535edb4 req-d4356c07-fdc7-4a9a-bfb7-84eee646f471 service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Detach interface failed, port_id=74ff529b-38db-4002-b259-f8bcf989ba68, reason: Instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updated VIF entry in instance network info cache for port 6472c753-29dc-40b6-be7a-761e5596244a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8488579e-a348-4252-82e9-37ffb3b309ef req-ca2a421f-43e6-4c70-932e-7df84703a8d7 service nova] Releasing lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:41:52 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Took 4.47 seconds to deallocate network for instance.
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:41:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:41:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:41:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:41:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:41:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:41:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-e9674679-428e-44d8-9391-b5e1a5d1b0ca req-c9716d43-d9a0-4f2d-9b9b-f03d9375ffaa service nova] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Received event network-vif-deleted-7b20824a-3150-43fc-8188-4ebbc0e11d4c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:41:55 user nova-compute[75648]: INFO nova.compute.manager [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] [instance: 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1] Took 2.45 seconds to detach 3 volumes for instance.
Nov 15 05:41:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:41:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:41:55 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:41:55 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:41:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:55 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Deleted allocations for instance 9bf56e1c-854a-4d47-8569-c71d2c6cc8c1
Nov 15 05:41:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-608250a0-fddf-4280-811d-d71a720818b3 tempest-TaggedBootDevicesTest_v242-1891485400 tempest-TaggedBootDevicesTest_v242-1891485400-project-member] Lock "9bf56e1c-854a-4d47-8569-c71d2c6cc8c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.673s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG os_brick.utils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[227357d7-6bbf-418c-9fad-af289c603493]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f844b929-b0e8-4816-8d49-c6dfb8a35918]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc647b8c-c15a-401a-80a6-3c7ec2a5b763]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[24942e4f-b78f-4a76-8166-e2ab69b53269]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:41:56 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:41:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[672cc4b4-032c-4423-98da-0a1128665b7b]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG os_brick.utils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating existing volume attachment record: bcc39fb4-df67-4740-bd45-19cf3ce2ce2a {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:41:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:41:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:42:01 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Creating image(s)
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Ensure instance console log exists: /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Start _get_guest_xml network_info=[{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'bcc39fb4-df67-4740-bd45-19cf3ce2ce2a', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3', 'attached_at': '', 'detached_at': '', 'volume_id': '986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'serial': '986f90c5-4d1a-44ec-979f-11b82dc0e3ff'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:42:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:01 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:01 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:01 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2f9f13-d873-447f-9779-1a36b3938cd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:42:01 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb36b0-3c0d-44d3-83fa-426627e34e93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff] added
Nov 15 05:42:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca0500-c14c-4b95-b2a8-75bb87659399]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[87997fae-5e90-472a-81b0-61c4a2bb8fed]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLtjXNQK {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLtjXNQK" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d476ec-90e9-4990-a127-4eb77e833289]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLtjXNQK'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc8125e-aa74-4f7e-8c81-f77356fec271]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d95bd4-ffa5-4a7e-a723-08b33c0cba3e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:42:01 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:01 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:42:01 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:01 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --login" returned: 0 in 1.070s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c4dde-891c-44e3-891e-53396d3e1514]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260]
Nov 15 05:42:02 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b391e5-8375-4411-85cd-e1452690f086]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c52296-04a6-444b-a6b2-6a521b0a21d4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:42:02 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:02 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:02 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:42:02 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:02 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:02 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.308s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[000087f2-7c48-4dea-b35f-3d0b564f2091]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:42:03 user nova-compute[75648]: INFO nova.compute.claims [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Claim successful on node user
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:42:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.policy [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bfedcfe15ef443a5a72181d36da14635', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e0dd038b71424fb24a32f15c6b0abd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:42:03 user nova-compute[75648]: INFO nova.virt.block_device [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Booting with volume 64316407-b9e7-40e7-aa40-16b428a45059 at /dev/vda
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.utils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[42e97ff7-de7f-4323-86fc-22c498adbf04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5bfd94-1a38-4956-96e4-8bf824bf5b8f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[488082a5-3da7-4456-8b0e-c1fa31608c87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d541c6-0c74-452f-9716-8588eceb403f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:42:03 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:42:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[86eb6508-ee7a-4760-9d86-2779c695fb13]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.utils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updating existing volume attachment record: e5f91d09-2686-43a3-956f-1e6990b25578 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.350s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== connect_volume: return (2351ms) {'type': 'block', 'scsi_wwn': '23661663565333732', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661663565333732', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-725986689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-725986689',id=14,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-xqtcs61e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:41:50Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:42:03 user nova-compute[75648]:   <uuid>3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3</uuid>
Nov 15 05:42:03 user nova-compute[75648]:   <name>instance-0000000e</name>
Nov 15 05:42:03 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:42:03 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:42:03 user nova-compute[75648]:   <metadata>
Nov 15 05:42:03 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:42:03 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:42:03 user nova-compute[75648]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-725986689</nova:name>
Nov 15 05:42:03 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:42:01</nova:creationTime>
Nov 15 05:42:03 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:42:03 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:42:03 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:42:03 user nova-compute[75648]:       <nova:owner>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:user uuid="47b4817a59584433a28790c3a16d0b5c">tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member</nova:user>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:project uuid="c13f9a55b45f4f9992e2f86628b34982">tempest-ServerBootFromVolumeStableRescueTest-893883912</nova:project>
Nov 15 05:42:03 user nova-compute[75648]:       </nova:owner>
Nov 15 05:42:03 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:42:03 user nova-compute[75648]:       <nova:ports>
Nov 15 05:42:03 user nova-compute[75648]:         <nova:port uuid="6472c753-29dc-40b6-be7a-761e5596244a">
Nov 15 05:42:03 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 05:42:03 user nova-compute[75648]:         </nova:port>
Nov 15 05:42:03 user nova-compute[75648]:       </nova:ports>
Nov 15 05:42:03 user nova-compute[75648]:     </nova:instance>
Nov 15 05:42:03 user nova-compute[75648]:   </metadata>
Nov 15 05:42:03 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:42:03 user nova-compute[75648]:     <system>
Nov 15 05:42:03 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:42:03 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:42:03 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:42:03 user nova-compute[75648]:       <entry name="serial">3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3</entry>
Nov 15 05:42:03 user nova-compute[75648]:       <entry name="uuid">3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3</entry>
Nov 15 05:42:03 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:42:03 user nova-compute[75648]:     </system>
Nov 15 05:42:03 user nova-compute[75648]:   </sysinfo>
Nov 15 05:42:03 user nova-compute[75648]:   <os>
Nov 15 05:42:03 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:42:03 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:42:03 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:42:03 user nova-compute[75648]:   </os>
Nov 15 05:42:03 user nova-compute[75648]:   <features>
Nov 15 05:42:03 user nova-compute[75648]:     <acpi/>
Nov 15 05:42:03 user nova-compute[75648]:     <apic/>
Nov 15 05:42:03 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:42:03 user nova-compute[75648]:   </features>
Nov 15 05:42:03 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:42:03 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:42:03 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:42:03 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:42:03 user nova-compute[75648]:   </clock>
Nov 15 05:42:03 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:42:03 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:42:03 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:42:03 user nova-compute[75648]:   </cpu>
Nov 15 05:42:03 user nova-compute[75648]:   <devices>
Nov 15 05:42:03 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:42:03 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:42:03 user nova-compute[75648]:       <source dev="/dev/sdb"/>
Nov 15 05:42:03 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:42:03 user nova-compute[75648]:       <serial>986f90c5-4d1a-44ec-979f-11b82dc0e3ff</serial>
Nov 15 05:42:03 user nova-compute[75648]:     </disk>
Nov 15 05:42:03 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:42:03 user nova-compute[75648]:       <mac address="fa:16:3e:81:0f:aa"/>
Nov 15 05:42:03 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:03 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:42:03 user nova-compute[75648]:       <target dev="tap6472c753-29"/>
Nov 15 05:42:03 user nova-compute[75648]:     </interface>
Nov 15 05:42:03 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:42:03 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/console.log" append="off"/>
Nov 15 05:42:03 user nova-compute[75648]:     </serial>
Nov 15 05:42:03 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:42:03 user nova-compute[75648]:     <video>
Nov 15 05:42:03 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:03 user nova-compute[75648]:     </video>
Nov 15 05:42:03 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:42:03 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:42:03 user nova-compute[75648]:     </rng>
Nov 15 05:42:03 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:42:03 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:42:03 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:42:03 user nova-compute[75648]:     </memballoon>
Nov 15 05:42:03 user nova-compute[75648]:   </devices>
Nov 15 05:42:03 user nova-compute[75648]: </domain>
Nov 15 05:42:03 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-725986689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-725986689',id=14,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-xqtcs61e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:41:50Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG os_vif [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7b85a6a-09fe-5885-97d7-316c37ff0f19', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6472c753-29, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6472c753-29, col_values=(('qos', UUID('55a32c9d-5f03-4cd6-9034-f36141c58761')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6472c753-29, col_values=(('external_ids', {'iface-id': '6472c753-29dc-40b6-be7a-761e5596244a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:0f:aa', 'vm-uuid': '3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:03 user nova-compute[75648]: INFO os_vif [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29')
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No VIF found with MAC fa:16:3e:81:0f:aa, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Successfully created port: 6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Successfully updated port: 6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquired lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-changed-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Refreshing instance network info cache due to event network-changed-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] Acquiring lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updating instance_info_cache with network_info: [{"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Releasing lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance network_info: |[{"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] Acquired lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Refreshing network info cache for port 6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-c2567037-2ea6-4aa0-a164-6fb967345193 req-143b6895-b3c7-400a-84bc-976e7adf3e99 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c2567037-2ea6-4aa0-a164-6fb967345193 req-143b6895-b3c7-400a-84bc-976e7adf3e99 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c2567037-2ea6-4aa0-a164-6fb967345193 req-143b6895-b3c7-400a-84bc-976e7adf3e99 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c2567037-2ea6-4aa0-a164-6fb967345193 req-143b6895-b3c7-400a-84bc-976e7adf3e99 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-c2567037-2ea6-4aa0-a164-6fb967345193 req-143b6895-b3c7-400a-84bc-976e7adf3e99 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:05 user nova-compute[75648]: WARNING nova.compute.manager [req-c2567037-2ea6-4aa0-a164-6fb967345193 req-143b6895-b3c7-400a-84bc-976e7adf3e99 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state building and task_state spawning.
Nov 15 05:42:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updated VIF entry in instance network info cache for port 6cc6ade0-cf5d-4caf-b7f8-5df427c874ce. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updating instance_info_cache with network_info: [{"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-52b29e26-6a01-4fca-848c-daa287ddd860 req-7df83e01-632f-49f7-ac15-a4842fd7175e service nova] Releasing lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 is timed out.
Nov 15 05:42:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Successfully detached device vdb from instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 from the live domain config.
Nov 15 05:42:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mbUXZLcw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'b2d32e57-63ef-4c98-ab17-cd43abad7bff'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:06 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9243d7-5cb0-468a-932b-11c54bc69595]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:42:06 user nova-compute[75648]: No targets found.
Nov 15 05:42:06 user nova-compute[75648]: iSNS:
Nov 15 05:42:06 user nova-compute[75648]: No targets found.
Nov 15 05:42:06 user nova-compute[75648]: STATIC:
Nov 15 05:42:06 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:42:06 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:06 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:06 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:42:06 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:06 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:06 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:42:06 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:06 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:06 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff
Nov 15 05:42:06 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:06 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:06 user nova-compute[75648]: FIRMWARE:
Nov 15 05:42:06 user nova-compute[75648]: No targets found.
Nov 15 05:42:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:42:06 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:42:06 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b095c0-0a85-4bb3-b4ec-0f70c28b235a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d60c4b-c030-4a66-8b05-95878971da05]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:42:06 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:06 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:06 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff (non-flash)
Nov 15 05:42:06 user nova-compute[75648]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:06 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:06 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47aff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff'): ({'sdf'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Removing single pathed devices sdf {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b2591f-b02f-4edd-993e-eba1b20409fe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1420c91-74a6-4a10-af30-c87ca67ec3e3]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Flushing IO for device /dev/sdf {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe25275-fa6f-4138-896a-9039805a7f7d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2ef1b6-e928-4c0e-b94f-7d2568b25afd]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6c70ef-7621-494d-a9cb-b8739159fe05]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e90bce-7760-4548-aea6-16fa8451ed5c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260]
Nov 15 05:42:06 user nova-compute[75648]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2d32e57-63ef-4c98-ab17-cd43abad7bff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ea262d-95fd-4018-8a20-3f6e0209bf2b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] <== disconnect_volume: return (309ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:42:07 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance spawned successfully.
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.compute.manager [req-c81171af-8263-4004-9b39-446a7eab0dce req-2899aea7-8718-4663-9b61-0cde36591ec5 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c81171af-8263-4004-9b39-446a7eab0dce req-2899aea7-8718-4663-9b61-0cde36591ec5 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c81171af-8263-4004-9b39-446a7eab0dce req-2899aea7-8718-4663-9b61-0cde36591ec5 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c81171af-8263-4004-9b39-446a7eab0dce req-2899aea7-8718-4663-9b61-0cde36591ec5 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.compute.manager [req-c81171af-8263-4004-9b39-446a7eab0dce req-2899aea7-8718-4663-9b61-0cde36591ec5 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:07 user nova-compute[75648]: WARNING nova.compute.manager [req-c81171af-8263-4004-9b39-446a7eab0dce req-2899aea7-8718-4663-9b61-0cde36591ec5 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state building and task_state spawning.
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lazy-loading 'flavor' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:07 user nova-compute[75648]: INFO nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6e57c283-a800-4c2e-84aa-e412812a4b2c tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.969s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:07 user nova-compute[75648]: INFO nova.compute.manager [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Took 17.94 seconds to build instance.
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a98731f5-10dc-48df-8d8e-0a8c05495091 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.079s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "cd824673-df28-499e-8fa7-008d97468407" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:42:07 user nova-compute[75648]: INFO nova.compute.claims [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Claim successful on node user
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:42:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.policy [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfefd577d6e44a2599e03538f036dd18', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109b77e151fd4fdbb160739d831a08e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:42:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Creating image(s)
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "/opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "/opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:42:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Creating image(s)
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Ensure instance console log exists: /opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Start _get_guest_xml network_info=[{"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'e5f91d09-2686-43a3-956f-1e6990b25578', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0d5e58b-f341-43bc-bfd4-e59eec2c1064', 'attached_at': '', 'detached_at': '', 'volume_id': '64316407-b9e7-40e7-aa40-16b428a45059', 'serial': '64316407-b9e7-40e7-aa40-16b428a45059'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:42:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:08 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:08 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:08 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0979bdfb-7681-47c0-92ce-b2f37a863913]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:42:08 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.056s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da253d8-65d6-4c61-a63d-520ce680976b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059] added
Nov 15 05:42:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dc91a6-7294-4bb3-9f9e-22ab7749dbfc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c05084-0f4a-41f2-881b-14a0767264da]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mySbqVYC {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mySbqVYC" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ec6b08-d264-4ae9-99ed-78459120c566]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mySbqVYC'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a28124-336b-482c-a671-4cc181d89f95]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3e1a22-4dd6-4fac-a523-3475d9c45394]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:08 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:08 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:08 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:08 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[486e93ec-3c01-4c3e-987a-07d0406b4e11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]
Nov 15 05:42:08 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Successfully created port: 9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk 1073741824" returned: 0 in 0.084s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d9439-e6f1-487f-b318-17b77377de21]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0db4204b-647c-4f89-bb65-20792bc10bdb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:09 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:09 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:09 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:09 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:09 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:09 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:09 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:09 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.402s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[567e2d97-f8f9-45b7-b643-e75cf7545554]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Cannot resize image /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Ensure instance console log exists: /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 is timed out.
Nov 15 05:42:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully detached device vdb from instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 from the live domain config.
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Successfully updated port: 9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uUgHnSFo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:09 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "refresh_cache-cd824673-df28-499e-8fa7-008d97468407" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquired lock "refresh_cache-cd824673-df28-499e-8fa7-008d97468407" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-changed-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Refreshing instance network info cache due to event network-changed-9214936c-68b0-4726-891b-8e2598a21498. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] Acquiring lock "refresh_cache-cd824673-df28-499e-8fa7-008d97468407" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Updating instance_info_cache with network_info: [{"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Releasing lock "refresh_cache-cd824673-df28-499e-8fa7-008d97468407" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Instance network_info: |[{"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] Acquired lock "refresh_cache-cd824673-df28-499e-8fa7-008d97468407" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.neutron [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Refreshing network info cache for port 9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Start _get_guest_xml network_info=[{"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:42:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-656190521',display_name='tempest-VolumesAdminNegativeTest-server-656190521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-656190521',id=16,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109b77e151fd4fdbb160739d831a08e1',ramdisk_id='',reservation_id='r-8qh2a3lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1862472137',owner_user_name='tempest-VolumesAdminNegativeTest-1862472137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:08Z,user_data=None,user_id='cfefd577d6e44a2599e03538f036dd18',uuid=cd824673-df28-499e-8fa7-008d97468407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converting VIF {"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'pci_devices' on Instance uuid cd824673-df28-499e-8fa7-008d97468407 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:42:09 user nova-compute[75648]:   <uuid>cd824673-df28-499e-8fa7-008d97468407</uuid>
Nov 15 05:42:09 user nova-compute[75648]:   <name>instance-00000010</name>
Nov 15 05:42:09 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:42:09 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:42:09 user nova-compute[75648]:   <metadata>
Nov 15 05:42:09 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:42:09 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:42:09 user nova-compute[75648]:       <nova:name>tempest-VolumesAdminNegativeTest-server-656190521</nova:name>
Nov 15 05:42:09 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:42:09</nova:creationTime>
Nov 15 05:42:09 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:42:09 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:42:09 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:42:09 user nova-compute[75648]:       <nova:owner>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:user uuid="cfefd577d6e44a2599e03538f036dd18">tempest-VolumesAdminNegativeTest-1862472137-project-member</nova:user>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:project uuid="109b77e151fd4fdbb160739d831a08e1">tempest-VolumesAdminNegativeTest-1862472137</nova:project>
Nov 15 05:42:09 user nova-compute[75648]:       </nova:owner>
Nov 15 05:42:09 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:42:09 user nova-compute[75648]:       <nova:ports>
Nov 15 05:42:09 user nova-compute[75648]:         <nova:port uuid="9214936c-68b0-4726-891b-8e2598a21498">
Nov 15 05:42:09 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:42:09 user nova-compute[75648]:         </nova:port>
Nov 15 05:42:09 user nova-compute[75648]:       </nova:ports>
Nov 15 05:42:09 user nova-compute[75648]:     </nova:instance>
Nov 15 05:42:09 user nova-compute[75648]:   </metadata>
Nov 15 05:42:09 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:42:09 user nova-compute[75648]:     <system>
Nov 15 05:42:09 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:42:09 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:42:09 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:42:09 user nova-compute[75648]:       <entry name="serial">cd824673-df28-499e-8fa7-008d97468407</entry>
Nov 15 05:42:09 user nova-compute[75648]:       <entry name="uuid">cd824673-df28-499e-8fa7-008d97468407</entry>
Nov 15 05:42:09 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:42:09 user nova-compute[75648]:     </system>
Nov 15 05:42:09 user nova-compute[75648]:   </sysinfo>
Nov 15 05:42:09 user nova-compute[75648]:   <os>
Nov 15 05:42:09 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:42:09 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:42:09 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:42:09 user nova-compute[75648]:   </os>
Nov 15 05:42:09 user nova-compute[75648]:   <features>
Nov 15 05:42:09 user nova-compute[75648]:     <acpi/>
Nov 15 05:42:09 user nova-compute[75648]:     <apic/>
Nov 15 05:42:09 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:42:09 user nova-compute[75648]:   </features>
Nov 15 05:42:09 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:42:09 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:42:09 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:42:09 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:42:09 user nova-compute[75648]:   </clock>
Nov 15 05:42:09 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:42:09 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:42:09 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:42:09 user nova-compute[75648]:   </cpu>
Nov 15 05:42:09 user nova-compute[75648]:   <devices>
Nov 15 05:42:09 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:42:09 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:42:09 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk"/>
Nov 15 05:42:09 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:42:09 user nova-compute[75648]:     </disk>
Nov 15 05:42:09 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:42:09 user nova-compute[75648]:       <mac address="fa:16:3e:c7:e3:30"/>
Nov 15 05:42:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:09 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:42:09 user nova-compute[75648]:       <target dev="tap9214936c-68"/>
Nov 15 05:42:09 user nova-compute[75648]:     </interface>
Nov 15 05:42:09 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:42:09 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/console.log" append="off"/>
Nov 15 05:42:09 user nova-compute[75648]:     </serial>
Nov 15 05:42:09 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:42:09 user nova-compute[75648]:     <video>
Nov 15 05:42:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:09 user nova-compute[75648]:     </video>
Nov 15 05:42:09 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:42:09 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:42:09 user nova-compute[75648]:     </rng>
Nov 15 05:42:09 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:42:09 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:42:09 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:42:09 user nova-compute[75648]:     </memballoon>
Nov 15 05:42:09 user nova-compute[75648]:   </devices>
Nov 15 05:42:09 user nova-compute[75648]: </domain>
Nov 15 05:42:09 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-656190521',display_name='tempest-VolumesAdminNegativeTest-server-656190521',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-656190521',id=16,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109b77e151fd4fdbb160739d831a08e1',ramdisk_id='',reservation_id='r-8qh2a3lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1862472137',owner_user_name='tempest-VolumesAdminNegativeTest-1862472137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:08Z,user_data=None,user_id='cfefd577d6e44a2599e03538f036dd18',uuid=cd824673-df28-499e-8fa7-008d97468407,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converting VIF {"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG os_vif [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '86376cf7-7467-510a-b623-4b5d82ef2f13', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9214936c-68, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9214936c-68, col_values=(('qos', UUID('b586bde6-6a36-4a31-8eae-fce1a6b42075')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9214936c-68, col_values=(('external_ids', {'iface-id': '9214936c-68b0-4726-891b-8e2598a21498', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:e3:30', 'vm-uuid': 'cd824673-df28-499e-8fa7-008d97468407'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:09 user nova-compute[75648]: INFO os_vif [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68')
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] No VIF found with MAC fa:16:3e:c7:e3:30, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '23562613632316134', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562613632316134', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.565s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df0a3bb-48a8-41ba-a079-07c79f7069b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:42:10 user nova-compute[75648]: No targets found.
Nov 15 05:42:10 user nova-compute[75648]: iSNS:
Nov 15 05:42:10 user nova-compute[75648]: No targets found.
Nov 15 05:42:10 user nova-compute[75648]: STATIC:
Nov 15 05:42:10 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:42:10 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:10 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:10 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23
Nov 15 05:42:10 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:10 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:10 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:42:10 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:10 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:10 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:42:10 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:10 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:10 user nova-compute[75648]: FIRMWARE:
Nov 15 05:42:10 user nova-compute[75648]: No targets found.
Nov 15 05:42:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:42:10 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:42:10 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33211dd-19cf-4473-9bb3-10e6b52c395d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03ec2ed-f208-40cb-aacd-97e345b8bd51]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:10 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:10 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:10 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 (non-flash)
Nov 15 05:42:10 user nova-compute[75648]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:10 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:10 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47cf640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23'): ({'sdg'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Removing single pathed devices sdg {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[91792c6f-1c31-4502-b41f-9b959d2e7025]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd3323-b250-4bf3-a1c4-064fc8b8ba76]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Flushing IO for device /dev/sdg {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd248b8-1bef-4dbc-9458-6cc0600e032f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Updated VIF entry in instance network info cache for port 9214936c-68b0-4726-891b-8e2598a21498. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Updating instance_info_cache with network_info: [{"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c1a67776-6b03-47f6-b388-31fb50209087 req-aeb0acd4-e3a5-41ca-91c2-23e82811bdef service nova] Releasing lock "refresh_cache-cd824673-df28-499e-8fa7-008d97468407" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.052s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5627ac5-6919-401d-8591-7c2ef1c9a597]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-660236792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-660236792',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4TXXCUK1Zw5Q+zcG+nWn0/MlQIY8M6XgKF3HFBzzdeY6r8jDU/9lHGfjHL9z8KJ02ixkcmhgFHolLoWTeOShPOEMMUDtp7GwANshhAI/PTC2qnoHaRFZXIqjm/arwhkw==',key_name='tempest-keypair-2070814856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e0dd038b71424fb24a32f15c6b0abd',ramdisk_id='',reservation_id='r-a81ik3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1489834400',owner_user_name='tempest-ServerActionsV293TestJSON-1489834400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfedcfe15ef443a5a72181d36da14635',uuid=c0d5e58b-f341-43bc-bfd4-e59eec2c1064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converting VIF {"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lazy-loading 'pci_devices' on Instance uuid c0d5e58b-f341-43bc-bfd4-e59eec2c1064 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[092a49f1-13e5-4e0c-bf9d-74d0a4e6c4d5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:42:10 user nova-compute[75648]:   <uuid>c0d5e58b-f341-43bc-bfd4-e59eec2c1064</uuid>
Nov 15 05:42:10 user nova-compute[75648]:   <name>instance-0000000f</name>
Nov 15 05:42:10 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:42:10 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:42:10 user nova-compute[75648]:   <metadata>
Nov 15 05:42:10 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:42:10 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:42:10 user nova-compute[75648]:       <nova:name>tempest-ServerActionsV293TestJSON-server-660236792</nova:name>
Nov 15 05:42:10 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:42:08</nova:creationTime>
Nov 15 05:42:10 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:42:10 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:42:10 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:42:10 user nova-compute[75648]:       <nova:owner>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:user uuid="bfedcfe15ef443a5a72181d36da14635">tempest-ServerActionsV293TestJSON-1489834400-project-member</nova:user>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:project uuid="e4e0dd038b71424fb24a32f15c6b0abd">tempest-ServerActionsV293TestJSON-1489834400</nova:project>
Nov 15 05:42:10 user nova-compute[75648]:       </nova:owner>
Nov 15 05:42:10 user nova-compute[75648]:       <nova:ports>
Nov 15 05:42:10 user nova-compute[75648]:         <nova:port uuid="6cc6ade0-cf5d-4caf-b7f8-5df427c874ce">
Nov 15 05:42:10 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:42:10 user nova-compute[75648]:         </nova:port>
Nov 15 05:42:10 user nova-compute[75648]:       </nova:ports>
Nov 15 05:42:10 user nova-compute[75648]:     </nova:instance>
Nov 15 05:42:10 user nova-compute[75648]:   </metadata>
Nov 15 05:42:10 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:42:10 user nova-compute[75648]:     <system>
Nov 15 05:42:10 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:42:10 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:42:10 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:42:10 user nova-compute[75648]:       <entry name="serial">c0d5e58b-f341-43bc-bfd4-e59eec2c1064</entry>
Nov 15 05:42:10 user nova-compute[75648]:       <entry name="uuid">c0d5e58b-f341-43bc-bfd4-e59eec2c1064</entry>
Nov 15 05:42:10 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:42:10 user nova-compute[75648]:     </system>
Nov 15 05:42:10 user nova-compute[75648]:   </sysinfo>
Nov 15 05:42:10 user nova-compute[75648]:   <os>
Nov 15 05:42:10 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:42:10 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:42:10 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:42:10 user nova-compute[75648]:   </os>
Nov 15 05:42:10 user nova-compute[75648]:   <features>
Nov 15 05:42:10 user nova-compute[75648]:     <acpi/>
Nov 15 05:42:10 user nova-compute[75648]:     <apic/>
Nov 15 05:42:10 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:42:10 user nova-compute[75648]:   </features>
Nov 15 05:42:10 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:42:10 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:42:10 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:42:10 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:42:10 user nova-compute[75648]:   </clock>
Nov 15 05:42:10 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:42:10 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:42:10 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:42:10 user nova-compute[75648]:   </cpu>
Nov 15 05:42:10 user nova-compute[75648]:   <devices>
Nov 15 05:42:10 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:42:10 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:42:10 user nova-compute[75648]:       <source dev="/dev/sdc"/>
Nov 15 05:42:10 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:42:10 user nova-compute[75648]:       <serial>64316407-b9e7-40e7-aa40-16b428a45059</serial>
Nov 15 05:42:10 user nova-compute[75648]:     </disk>
Nov 15 05:42:10 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:42:10 user nova-compute[75648]:       <mac address="fa:16:3e:4e:d6:00"/>
Nov 15 05:42:10 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:10 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:42:10 user nova-compute[75648]:       <target dev="tap6cc6ade0-cf"/>
Nov 15 05:42:10 user nova-compute[75648]:     </interface>
Nov 15 05:42:10 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:42:10 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064/console.log" append="off"/>
Nov 15 05:42:10 user nova-compute[75648]:     </serial>
Nov 15 05:42:10 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:42:10 user nova-compute[75648]:     <video>
Nov 15 05:42:10 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:10 user nova-compute[75648]:     </video>
Nov 15 05:42:10 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:42:10 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:42:10 user nova-compute[75648]:     </rng>
Nov 15 05:42:10 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:42:10 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:42:10 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:42:10 user nova-compute[75648]:     </memballoon>
Nov 15 05:42:10 user nova-compute[75648]:   </devices>
Nov 15 05:42:10 user nova-compute[75648]: </domain>
Nov 15 05:42:10 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-660236792',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-660236792',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4TXXCUK1Zw5Q+zcG+nWn0/MlQIY8M6XgKF3HFBzzdeY6r8jDU/9lHGfjHL9z8KJ02ixkcmhgFHolLoWTeOShPOEMMUDtp7GwANshhAI/PTC2qnoHaRFZXIqjm/arwhkw==',key_name='tempest-keypair-2070814856',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e4e0dd038b71424fb24a32f15c6b0abd',ramdisk_id='',reservation_id='r-a81ik3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1489834400',owner_user_name='tempest-ServerActionsV293TestJSON-1489834400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfedcfe15ef443a5a72181d36da14635',uuid=c0d5e58b-f341-43bc-bfd4-e59eec2c1064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converting VIF {"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_vif [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '758923e0-093c-54c4-86cc-a09bcd0f461b', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cc6ade0-cf, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cc6ade0-cf, col_values=(('qos', UUID('cfdf41d4-49c7-435d-8882-c534dd46f010')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cc6ade0-cf, col_values=(('external_ids', {'iface-id': '6cc6ade0-cf5d-4caf-b7f8-5df427c874ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:d6:00', 'vm-uuid': 'c0d5e58b-f341-43bc-bfd4-e59eec2c1064'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:10 user nova-compute[75648]: INFO os_vif [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf')
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9da51e-5133-4afc-bdb4-2b5e40977420]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260]
Nov 15 05:42:10 user nova-compute[75648]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f9a4e7e8-3983-47ac-a3d2-a5bb11e4df23 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd56103-736b-4ad1-803d-d8550b79718d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] <== disconnect_volume: return (869ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] No VIF found with MAC fa:16:3e:4e:d6:00, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:11 user nova-compute[75648]: DEBUG nova.objects.instance [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'flavor' on Instance uuid 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-950414cb-2dc2-4cb3-9874-b42ebcaa0825 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.575s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-82fbf58e-5db0-4bd8-8924-9c0e4527de75 req-b2742e3f-e042-4dd6-8d05-4146f7540928 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82fbf58e-5db0-4bd8-8924-9c0e4527de75 req-b2742e3f-e042-4dd6-8d05-4146f7540928 service nova] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82fbf58e-5db0-4bd8-8924-9c0e4527de75 req-b2742e3f-e042-4dd6-8d05-4146f7540928 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82fbf58e-5db0-4bd8-8924-9c0e4527de75 req-b2742e3f-e042-4dd6-8d05-4146f7540928 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-82fbf58e-5db0-4bd8-8924-9c0e4527de75 req-b2742e3f-e042-4dd6-8d05-4146f7540928 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] No waiting events found dispatching network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:12 user nova-compute[75648]: WARNING nova.compute.manager [req-82fbf58e-5db0-4bd8-8924-9c0e4527de75 req-b2742e3f-e042-4dd6-8d05-4146f7540928 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received unexpected event network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 for instance with vm_state building and task_state spawning.
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-5eab4d28-d981-4c98-998b-b05f0540c44e req-b592f916-c627-48a8-8a5b-9688771b260d service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5eab4d28-d981-4c98-998b-b05f0540c44e req-b592f916-c627-48a8-8a5b-9688771b260d service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5eab4d28-d981-4c98-998b-b05f0540c44e req-b592f916-c627-48a8-8a5b-9688771b260d service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5eab4d28-d981-4c98-998b-b05f0540c44e req-b592f916-c627-48a8-8a5b-9688771b260d service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-5eab4d28-d981-4c98-998b-b05f0540c44e req-b592f916-c627-48a8-8a5b-9688771b260d service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:12 user nova-compute[75648]: WARNING nova.compute.manager [req-5eab4d28-d981-4c98-998b-b05f0540c44e req-b592f916-c627-48a8-8a5b-9688771b260d service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state building and task_state spawning.
Nov 15 05:42:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-50242c98-e7e3-4a45-8fbc-41c1d74f5ebe req-ba83596d-9ba8-4713-a96b-d9b747772158 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-50242c98-e7e3-4a45-8fbc-41c1d74f5ebe req-ba83596d-9ba8-4713-a96b-d9b747772158 service nova] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-50242c98-e7e3-4a45-8fbc-41c1d74f5ebe req-ba83596d-9ba8-4713-a96b-d9b747772158 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-50242c98-e7e3-4a45-8fbc-41c1d74f5ebe req-ba83596d-9ba8-4713-a96b-d9b747772158 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-50242c98-e7e3-4a45-8fbc-41c1d74f5ebe req-ba83596d-9ba8-4713-a96b-d9b747772158 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] No waiting events found dispatching network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:14 user nova-compute[75648]: WARNING nova.compute.manager [req-50242c98-e7e3-4a45-8fbc-41c1d74f5ebe req-ba83596d-9ba8-4713-a96b-d9b747772158 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received unexpected event network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 for instance with vm_state building and task_state spawning.
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-b906927e-e3e1-4d61-8d76-3fe8c7d6084c req-04205cb3-d57c-4ddc-b4ae-9e229c02b513 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b906927e-e3e1-4d61-8d76-3fe8c7d6084c req-04205cb3-d57c-4ddc-b4ae-9e229c02b513 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b906927e-e3e1-4d61-8d76-3fe8c7d6084c req-04205cb3-d57c-4ddc-b4ae-9e229c02b513 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b906927e-e3e1-4d61-8d76-3fe8c7d6084c req-04205cb3-d57c-4ddc-b4ae-9e229c02b513 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-b906927e-e3e1-4d61-8d76-3fe8c7d6084c req-04205cb3-d57c-4ddc-b4ae-9e229c02b513 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:14 user nova-compute[75648]: WARNING nova.compute.manager [req-b906927e-e3e1-4d61-8d76-3fe8c7d6084c req-04205cb3-d57c-4ddc-b4ae-9e229c02b513 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state building and task_state spawning.
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:42:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance spawned successfully.
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:42:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cd824673-df28-499e-8fa7-008d97468407] Instance spawned successfully.
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:42:15 user nova-compute[75648]: INFO nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Took 6.49 seconds to spawn the instance on the hypervisor.
Nov 15 05:42:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:42:15 user nova-compute[75648]: INFO nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 15 05:42:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:42:15 user nova-compute[75648]: INFO nova.compute.manager [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Took 12.08 seconds to build instance.
Nov 15 05:42:15 user nova-compute[75648]: INFO nova.compute.manager [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Took 7.28 seconds to build instance.
Nov 15 05:42:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b7b0bf6-b402-4b57-ab94-c0ad071f09bb tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.200s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-add44722-07ec-4e28-8aec-77826ba56e4f tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "cd824673-df28-499e-8fa7-008d97468407" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.403s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:20 user nova-compute[75648]: INFO nova.compute.manager [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Terminating instance
Nov 15 05:42:20 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-6e26c88b-90f6-4b28-b8bc-869dab89a530 req-0dce0fe3-2269-4f1b-a277-fda02902f0c4 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-vif-unplugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6e26c88b-90f6-4b28-b8bc-869dab89a530 req-0dce0fe3-2269-4f1b-a277-fda02902f0c4 service nova] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6e26c88b-90f6-4b28-b8bc-869dab89a530 req-0dce0fe3-2269-4f1b-a277-fda02902f0c4 service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6e26c88b-90f6-4b28-b8bc-869dab89a530 req-0dce0fe3-2269-4f1b-a277-fda02902f0c4 service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-6e26c88b-90f6-4b28-b8bc-869dab89a530 req-0dce0fe3-2269-4f1b-a277-fda02902f0c4 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] No waiting events found dispatching network-vif-unplugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-6e26c88b-90f6-4b28-b8bc-869dab89a530 req-0dce0fe3-2269-4f1b-a277-fda02902f0c4 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-vif-unplugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:42:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Instance destroyed successfully.
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lazy-loading 'resources' on Instance uuid 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1311464084',display_name='tempest-VolumesAssistedSnapshotsTest-server-1311464084',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1311464084',id=10,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWhNrwtM49G01/LGGUeWSOfnIhrBWJm9KPIvQkOz4J6aoQEYkmgRXwigC5IOwXb+9Oa/sq3IyvtsJVIzlGVKfgEbxdZ5SAR3NbYy1cR0yAzsxkGACq8YMF/yUhLVP2XUw==',key_name='tempest-keypair-1141219711',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d9d7e1ca12a349478fbf6722059ec859',ramdisk_id='',reservation_id='r-rmdb9ssb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2077174352',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2077174352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:39:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d790a8fa34148109acfe00813c864b9',uuid=5a5c0387-b0a7-4f9a-9f6a-38aee76930ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Converting VIF {"id": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "address": "fa:16:3e:d1:2a:2b", "network": {"id": "7985925d-3a97-489e-9ee8-3c0f59e6c941", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1975935875-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d9d7e1ca12a349478fbf6722059ec859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4410ca77-8c", "ovs_interfaceid": "4410ca77-8cc0-4991-bd20-063ee83e9ee7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG os_vif [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4410ca77-8c, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4128c4fa-4487-4870-b308-bc8a3010c693) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:21 user nova-compute[75648]: INFO os_vif [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:2a:2b,bridge_name='br-int',has_traffic_filtering=True,id=4410ca77-8cc0-4991-bd20-063ee83e9ee7,network=Network(7985925d-3a97-489e-9ee8-3c0f59e6c941),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4410ca77-8c')
Nov 15 05:42:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Deleting instance files /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea_del
Nov 15 05:42:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Deletion of /opt/stack/data/nova/instances/5a5c0387-b0a7-4f9a-9f6a-38aee76930ea_del complete
Nov 15 05:42:21 user nova-compute[75648]: INFO nova.compute.manager [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 05:42:21 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:42:21 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "f2657470-018b-4c83-a7d2-4433401a7e17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.004s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:22 user nova-compute[75648]: INFO nova.compute.manager [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Terminating instance
Nov 15 05:42:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-54e6c93a-547f-42c6-a97a-3bd321e54d0c req-32749019-8948-4aa2-8974-9caacf5a01ad service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-vif-deleted-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:22 user nova-compute[75648]: INFO nova.compute.manager [req-54e6c93a-547f-42c6-a97a-3bd321e54d0c req-32749019-8948-4aa2-8974-9caacf5a01ad service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Neutron deleted interface 4410ca77-8cc0-4991-bd20-063ee83e9ee7; detaching it from the instance and deleting it from the info cache
Nov 15 05:42:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-54e6c93a-547f-42c6-a97a-3bd321e54d0c req-32749019-8948-4aa2-8974-9caacf5a01ad service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:22 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Took 1.00 seconds to deallocate network for instance.
Nov 15 05:42:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-54e6c93a-547f-42c6-a97a-3bd321e54d0c req-32749019-8948-4aa2-8974-9caacf5a01ad service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Detach interface failed, port_id=4410ca77-8cc0-4991-bd20-063ee83e9ee7, reason: Instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received event network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Acquiring lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] No waiting events found dispatching network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:23 user nova-compute[75648]: WARNING nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea] Received unexpected event network-vif-plugged-4410ca77-8cc0-4991-bd20-063ee83e9ee7 for instance with vm_state deleted and task_state None.
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-vif-unplugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] No waiting events found dispatching network-vif-unplugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-vif-unplugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Acquiring lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] Lock "f2657470-018b-4c83-a7d2-4433401a7e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] No waiting events found dispatching network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:23 user nova-compute[75648]: WARNING nova.compute.manager [req-35eca9c3-78b5-4332-9f2b-8e3166371f28 req-b8bf9bb1-bea0-411a-aa37-114fb797bef0 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received unexpected event network-vif-plugged-ff88f0da-40c2-4341-93a3-2a0fd0c4540a for instance with vm_state active and task_state deleting.
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Instance destroyed successfully.
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'resources' on Instance uuid f2657470-018b-4c83-a7d2-4433401a7e17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:40:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1384021572',display_name='tempest-TestVolumeBootPattern-server-1384021572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1384021572',id=13,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-djystsx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:51Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=f2657470-018b-4c83-a7d2-4433401a7e17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "address": "fa:16:3e:62:5e:84", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff88f0da-40", "ovs_interfaceid": "ff88f0da-40c2-4341-93a3-2a0fd0c4540a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_vif [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff88f0da-40, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66bae8c4-a20c-4dce-bf56-718458153403) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:23 user nova-compute[75648]: INFO os_vif [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:5e:84,bridge_name='br-int',has_traffic_filtering=True,id=ff88f0da-40c2-4341-93a3-2a0fd0c4540a,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff88f0da-40')
Nov 15 05:42:23 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Deleted allocations for instance 5a5c0387-b0a7-4f9a-9f6a-38aee76930ea
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UJBtLPoC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:23 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[664fb6d3-1f5b-464c-bcac-b18150bb774e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:42:23 user nova-compute[75648]: No targets found.
Nov 15 05:42:23 user nova-compute[75648]: iSNS:
Nov 15 05:42:23 user nova-compute[75648]: No targets found.
Nov 15 05:42:23 user nova-compute[75648]: STATIC:
Nov 15 05:42:23 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:42:23 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:23 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:23 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba
Nov 15 05:42:23 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:23 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:23 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:42:23 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:42:23 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:42:23 user nova-compute[75648]: FIRMWARE:
Nov 15 05:42:23 user nova-compute[75648]: No targets found.
Nov 15 05:42:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:42:23 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:42:23 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d955399-7ad6-47dc-b560-941c9a9da4c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38aabc5-0642-4b6e-999d-75ea987bf3b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:23 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:23 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:23 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:23 user nova-compute[75648]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba (non-flash)
Nov 15 05:42:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47f6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f6b3a7f-be9b-4432-904c-014bd25a8551 tempest-VolumesAssistedSnapshotsTest-2077174352 tempest-VolumesAssistedSnapshotsTest-2077174352-project-member] Lock "5a5c0387-b0a7-4f9a-9f6a-38aee76930ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.539s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5b9471-9624-45a3-8189-74122b9247bb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb5af8b-d5f9-413a-a087-0c60ddd1d0e7]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d459548c-41ee-48a9-a5a0-36d4a92c5f30]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.045s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7891c-ca9d-4121-b617-539c602e744c]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad25dc39-700d-4aa8-81a3-6537d4cd96f6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7cffbd-d2a1-4f7b-bd14-89d30834a14f]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260]
Nov 15 05:42:23 user nova-compute[75648]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f51ed74-b7d5-4069-ac66-647e2cd682ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42ae633-01d3-437d-9257-a413f1be3cd6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== disconnect_volume: return (322ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:42:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Deleting instance files /opt/stack/data/nova/instances/f2657470-018b-4c83-a7d2-4433401a7e17_del
Nov 15 05:42:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Deletion of /opt/stack/data/nova/instances/f2657470-018b-4c83-a7d2-4433401a7e17_del complete
Nov 15 05:42:23 user nova-compute[75648]: INFO nova.compute.manager [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 15 05:42:23 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:42:23 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:42:24 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:24 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Took 0.40 seconds to deallocate network for instance.
Nov 15 05:42:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-096ed28a-8a95-4773-a1bb-e263dd125572 req-be55d540-4960-4fc8-928b-a99bb5752aa1 service nova] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Received event network-vif-deleted-ff88f0da-40c2-4341-93a3-2a0fd0c4540a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:24 user nova-compute[75648]: INFO nova.compute.manager [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Took 0.78 seconds to detach 1 volumes for instance.
Nov 15 05:42:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: f2657470-018b-4c83-a7d2-4433401a7e17] Deleting volume: 4f51ed74-b7d5-4069-ac66-647e2cd682ba {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 05:42:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:25 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:25 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:25 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Deleted allocations for instance f2657470-018b-4c83-a7d2-4433401a7e17
Nov 15 05:42:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-707a0ee5-3b34-4f9b-b4e6-b105399e2c84 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "f2657470-018b-4c83-a7d2-4433401a7e17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.012s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:35 user nova-compute[75648]: INFO nova.compute.manager [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Terminating instance
Nov 15 05:42:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-cad692a7-b160-49ae-b6ab-f3948a820bea req-c1379365-9656-4e56-9e9c-bad63d71fe50 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-vif-unplugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cad692a7-b160-49ae-b6ab-f3948a820bea req-c1379365-9656-4e56-9e9c-bad63d71fe50 service nova] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cad692a7-b160-49ae-b6ab-f3948a820bea req-c1379365-9656-4e56-9e9c-bad63d71fe50 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cad692a7-b160-49ae-b6ab-f3948a820bea req-c1379365-9656-4e56-9e9c-bad63d71fe50 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-cad692a7-b160-49ae-b6ab-f3948a820bea req-c1379365-9656-4e56-9e9c-bad63d71fe50 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] No waiting events found dispatching network-vif-unplugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-cad692a7-b160-49ae-b6ab-f3948a820bea req-c1379365-9656-4e56-9e9c-bad63d71fe50 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-vif-unplugged-76b8b8e6-c430-4222-a726-7a45dd82c22b for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Instance destroyed successfully.
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lazy-loading 'resources' on Instance uuid 38f6fbf6-3909-49d8-ab29-fb57a1727394 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1150969963',display_name='tempest-TestVolumeSwap-server-1150969963',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1150969963',id=9,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANkAYrkjAjVkKNwjGvuLI9UHglgwq53W9numerFr+ftDDsGiu8SqskIQcMAqo9CzTF+UBvY6GCqX7s8QADY4ZA6LvCVMgnaVtQqs5sqLBfJhq3eJur/ro0747LifleNWg==',key_name='tempest-keypair-1784994168',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='82a3d44380d943c0b587daaff4a27992',ramdisk_id='',reservation_id='r-jpo2tgko',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2065413912',owner_user_name='tempest-TestVolumeSwap-2065413912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7765a4af7e94df98c56a63a6a8b9169',uuid=38f6fbf6-3909-49d8-ab29-fb57a1727394,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Converting VIF {"id": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "address": "fa:16:3e:70:be:15", "network": {"id": "966916f7-7103-46e8-88c8-0f45c34ed5e3", "bridge": "br-int", "label": "tempest-TestVolumeSwap-700524195-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "82a3d44380d943c0b587daaff4a27992", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76b8b8e6-c4", "ovs_interfaceid": "76b8b8e6-c430-4222-a726-7a45dd82c22b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG os_vif [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76b8b8e6-c4, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=483cb0a0-6097-442b-987d-0bc5c027e41a) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:36 user nova-compute[75648]: INFO os_vif [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:70:be:15,bridge_name='br-int',has_traffic_filtering=True,id=76b8b8e6-c430-4222-a726-7a45dd82c22b,network=Network(966916f7-7103-46e8-88c8-0f45c34ed5e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76b8b8e6-c4')
Nov 15 05:42:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Deleting instance files /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394_del
Nov 15 05:42:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Deletion of /opt/stack/data/nova/instances/38f6fbf6-3909-49d8-ab29-fb57a1727394_del complete
Nov 15 05:42:36 user nova-compute[75648]: INFO nova.compute.manager [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 05:42:36 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:42:36 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'flavor' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:37 user nova-compute[75648]: INFO nova.compute.manager [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Attaching volume dc9a592b-3819-402e-ac1c-cca273cc1626 to /dev/vdb
Nov 15 05:42:37 user nova-compute[75648]: DEBUG os_brick.utils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c95fe-eb75-4bed-ba68-31625c2cd8e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0d05de-53be-479f-8283-39563a241495]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1f08bb-8206-40f4-8f5a-dbd05494782c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[697cb7a0-e50a-4b5f-b2a2-b30d6aff45b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:42:37 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[724dba84-f187-4404-81e4-6c15f2100eac]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG os_brick.utils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating existing volume attachment record: 8d00e69b-39de-45de-a052-0781b99ba485 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-663e267e-7823-45a8-a3d5-bd4632bbdadd req-b345579d-97d3-4773-a91f-b55d7dd0314c service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-vif-deleted-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:37 user nova-compute[75648]: INFO nova.compute.manager [req-663e267e-7823-45a8-a3d5-bd4632bbdadd req-b345579d-97d3-4773-a91f-b55d7dd0314c service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Neutron deleted interface 76b8b8e6-c430-4222-a726-7a45dd82c22b; detaching it from the instance and deleting it from the info cache
Nov 15 05:42:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-663e267e-7823-45a8-a3d5-bd4632bbdadd req-b345579d-97d3-4773-a91f-b55d7dd0314c service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:37 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Took 1.00 seconds to deallocate network for instance.
Nov 15 05:42:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-663e267e-7823-45a8-a3d5-bd4632bbdadd req-b345579d-97d3-4773-a91f-b55d7dd0314c service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Detach interface failed, port_id=76b8b8e6-c430-4222-a726-7a45dd82c22b, reason: Instance 38f6fbf6-3909-49d8-ab29-fb57a1727394 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-40e4af17-737c-4778-9bce-8e476874a12a req-37e964d5-d41c-4330-8845-a3b583664573 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received event network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-40e4af17-737c-4778-9bce-8e476874a12a req-37e964d5-d41c-4330-8845-a3b583664573 service nova] Acquiring lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-40e4af17-737c-4778-9bce-8e476874a12a req-37e964d5-d41c-4330-8845-a3b583664573 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-40e4af17-737c-4778-9bce-8e476874a12a req-37e964d5-d41c-4330-8845-a3b583664573 service nova] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-40e4af17-737c-4778-9bce-8e476874a12a req-37e964d5-d41c-4330-8845-a3b583664573 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] No waiting events found dispatching network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:38 user nova-compute[75648]: WARNING nova.compute.manager [req-40e4af17-737c-4778-9bce-8e476874a12a req-37e964d5-d41c-4330-8845-a3b583664573 service nova] [instance: 38f6fbf6-3909-49d8-ab29-fb57a1727394] Received unexpected event network-vif-plugged-76b8b8e6-c430-4222-a726-7a45dd82c22b for instance with vm_state deleted and task_state None.
Nov 15 05:42:38 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:38 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Deleted allocations for instance 38f6fbf6-3909-49d8-ab29-fb57a1727394
Nov 15 05:42:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b29967f-7c92-4d71-bcd8-224fe8c19187 tempest-TestVolumeSwap-2065413912 tempest-TestVolumeSwap-2065413912-project-member] Lock "38f6fbf6-3909-49d8-ab29-fb57a1727394" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.597s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:39 user nova-compute[75648]: INFO nova.compute.manager [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Unshelving
Nov 15 05:42:39 user nova-compute[75648]: INFO nova.virt.block_device [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Booting with volume c0cd44d8-8f7f-4813-8c17-c1430067b14d at /dev/vdc
Nov 15 05:42:39 user nova-compute[75648]: DEBUG os_brick.utils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4d6b81-1863-4086-83e3-a044b04975ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[77921e1e-1c13-43eb-ba24-015c3bb56a2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c459bbe-d953-4b4d-ac82-506eedd58237]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc436a7-fca8-4377-9496-fd47baea7667]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:42:39 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:42:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c3ed10-cca7-43de-8bf9-a6541d944f37]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG os_brick.utils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:39 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating existing volume attachment record: 27a331b0-2ef1-4aa4-a4ae-eace93fff08d {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:42:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:42:41 user nova-compute[75648]: INFO nova.compute.manager [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] instance snapshotting
Nov 15 05:42:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Beginning live snapshot process
Nov 15 05:42:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn5mnjsya/e37c08c2622446598dddf2bcb7237b93.delta 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpn5mnjsya/e37c08c2622446598dddf2bcb7237b93.delta 1073741824" returned: 0 in 0.056s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 05:42:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLzRGfBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:43 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87e62a2-5ae0-4619-ac38-97edd221d3a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:42:43 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e262cc0-3b76-430c-949d-45a88b043867]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626] added
Nov 15 05:42:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8acf33-897d-4d17-8658-38edfad47231]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d014a348-8286-457f-8681-2d103ea97512]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLzRGfBD {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLzRGfBD" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e0b37be-14a6-4232-a3f4-738ad085b44a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLzRGfBD'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ecf6793-f784-4042-b231-c7f34d78a922]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1f97a-d44d-47fc-96a1-c546808ccd5b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:43 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:43 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b24b904-a2a5-4797-a14b-e0b10695a090]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260]
Nov 15 05:42:43 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d19dcd7-0bca-4b3e-9786-1ba1184db361]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabc571e-f4e2-4a58-84d8-d0e7d53bc4c1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:43 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:43 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:43 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:43 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.099s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44e301b-438a-4f65-abca-7883c474fe39]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLzRGfBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:42:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] COPY block job progress, current cursor: 19005440 final cursor: 75563008 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:42:44 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 05:42:44 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23066373131623865', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066373131623865', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'flavor' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn5mnjsya/e37c08c2622446598dddf2bcb7237b93.delta /opt/stack/data/nova/instances/snapshots/tmpn5mnjsya/e37c08c2622446598dddf2bcb7237b93 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:42:44 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:42:44 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:42:44 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:42:44 user nova-compute[75648]:   <serial>dc9a592b-3819-402e-ac1c-cca273cc1626</serial>
Nov 15 05:42:44 user nova-compute[75648]: </disk>
Nov 15 05:42:44 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:42:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No VIF found with MAC fa:16:3e:4c:49:4e, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpn5mnjsya/e37c08c2622446598dddf2bcb7237b93.delta /opt/stack/data/nova/instances/snapshots/tmpn5mnjsya/e37c08c2622446598dddf2bcb7237b93" returned: 0 in 0.692s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Snapshot extracted, beginning image upload
Nov 15 05:42:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b4e14247-bd34-48d6-9c3a-1056b87b9771 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.846s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'pci_requests' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:46 user nova-compute[75648]: INFO nova.compute.manager [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Rescuing
Nov 15 05:42:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'numa_topology' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:46 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:42:46 user nova-compute[75648]: INFO nova.compute.claims [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Claim successful on node user
Nov 15 05:42:47 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:47 user nova-compute[75648]: INFO nova.network.neutron [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating port f91e5406-2b2a-45e8-86a4-81edc6a8a06f with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-39a85bea-df50-4cf0-8c34-8e1061abbd0e req-15fbbbd2-12c9-4434-af4c-8590b2288fad service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-39a85bea-df50-4cf0-8c34-8e1061abbd0e req-15fbbbd2-12c9-4434-af4c-8590b2288fad service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-39a85bea-df50-4cf0-8c34-8e1061abbd0e req-15fbbbd2-12c9-4434-af4c-8590b2288fad service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-39a85bea-df50-4cf0-8c34-8e1061abbd0e req-15fbbbd2-12c9-4434-af4c-8590b2288fad service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-39a85bea-df50-4cf0-8c34-8e1061abbd0e req-15fbbbd2-12c9-4434-af4c-8590b2288fad service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:48 user nova-compute[75648]: WARNING nova.compute.manager [req-39a85bea-df50-4cf0-8c34-8e1061abbd0e req-15fbbbd2-12c9-4434-af4c-8590b2288fad service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state active and task_state rescuing.
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:42:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Snapshot image upload complete
Nov 15 05:42:48 user nova-compute[75648]: INFO nova.compute.manager [None req-288ae273-95af-410f-8c95-703c175888d9 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Took 7.14 seconds to snapshot the instance on the hypervisor.
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing instance network info cache due to event network-changed-f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance destroyed successfully.
Nov 15 05:42:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Attempting a stable device rescue
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75648) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:42:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Creating image(s)
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'trusted_certs' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "4f133114b5201e22b2d4e53700563f9bf081e1d7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "4f133114b5201e22b2d4e53700563f9bf081e1d7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.virt.images [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] fd590233-cc79-4945-94ba-2fe26464b938 was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.part /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:42:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Creating image(s)
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.063s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.network.neutron [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Refreshing network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.objects.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<4d78e23e-b1d9-4395-9885-c515e558f673> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "bec705b70844698fe08baa474216d6abd4b050a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "bec705b70844698fe08baa474216d6abd4b050a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-248353a7-c399-4bc9-95b1-0087a83eeb17 req-b43b9861-30f7-4af2-acdb-9571151ed223 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-248353a7-c399-4bc9-95b1-0087a83eeb17 req-b43b9861-30f7-4af2-acdb-9571151ed223 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-248353a7-c399-4bc9-95b1-0087a83eeb17 req-b43b9861-30f7-4af2-acdb-9571151ed223 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-248353a7-c399-4bc9-95b1-0087a83eeb17 req-b43b9861-30f7-4af2-acdb-9571151ed223 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-248353a7-c399-4bc9-95b1-0087a83eeb17 req-b43b9861-30f7-4af2-acdb-9571151ed223 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:50 user nova-compute[75648]: WARNING nova.compute.manager [req-248353a7-c399-4bc9-95b1-0087a83eeb17 req-b43b9861-30f7-4af2-acdb-9571151ed223 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state active and task_state rescuing.
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.part /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.converted" returned: 0 in 1.319s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.part --force-share --output=json" returned: 0 in 0.236s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG nova.virt.images [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] f031c544-e1ea-41aa-9052-24b4aac8d2f3 was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.part /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7.converted --force-share --output=json" returned: 0 in 0.227s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "4f133114b5201e22b2d4e53700563f9bf081e1d7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.684s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "4f133114b5201e22b2d4e53700563f9bf081e1d7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "4f133114b5201e22b2d4e53700563f9bf081e1d7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:42:51 user nova-compute[75648]: INFO nova.compute.claims [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Claim successful on node user
Nov 15 05:42:51 user nova-compute[75648]: DEBUG nova.network.neutron [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updated VIF entry in instance network info cache for port f91e5406-2b2a-45e8-86a4-81edc6a8a06f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG nova.network.neutron [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-120bd96a-3f7f-4b5c-b11a-1208dbcff4a2 req-2f0de1ae-8829-4064-af7c-a3299df30c40 service nova] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7 --force-share --output=json" returned: 0 in 0.202s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7,backing_fmt=raw /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.part /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.converted" returned: 0 in 0.339s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7,backing_fmt=raw /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue" returned: 0 in 0.149s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "4f133114b5201e22b2d4e53700563f9bf081e1d7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.356s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'migration_context' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Object Instance<fec7ed02-51fe-46d6-9d59-e6e21cb56e4c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Start _get_guest_xml network_info=[{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "vif_mac": "fa:16:3e:4c:49:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fd590233-cc79-4945-94ba-2fe26464b938', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '8d00e69b-39de-45de-a052-0781b99ba485', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLzRGfBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'fec7ed02-51fe-46d6-9d59-e6e21cb56e4c', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc9a592b-3819-402e-ac1c-cca273cc1626', 'serial': 'dc9a592b-3819-402e-ac1c-cca273cc1626'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'resources' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Object Instance<fec7ed02-51fe-46d6-9d59-e6e21cb56e4c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'numa_topology' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Object Instance<fec7ed02-51fe-46d6-9d59-e6e21cb56e4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:52 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:52 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'vcpu_model' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "bec705b70844698fe08baa474216d6abd4b050a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.871s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Object Instance<fec7ed02-51fe-46d6-9d59-e6e21cb56e4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLzRGfBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:52 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:52 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:52 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[257edbca-0397-46d9-b214-e96a17109878]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rLzRGfBD\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 05:42:52 user nova-compute[75648]: node.name = iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:42:52 user nova-compute[75648]: node.tpgt = -1
Nov 15 05:42:52 user nova-compute[75648]: node.startup = automatic
Nov 15 05:42:52 user nova-compute[75648]: node.leading_login = No
Nov 15 05:42:52 user nova-compute[75648]: iface.iscsi_ifacename = default
Nov 15 05:42:52 user nova-compute[75648]: iface.net_ifacename = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.ipaddress = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.prefix_len = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.hwaddress = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.transport_name = tcp
Nov 15 05:42:52 user nova-compute[75648]: iface.initiatorname = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.vlan_id = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.vlan_priority = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.vlan_state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.iface_num = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.mtu = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.port = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.bootproto = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.subnet_mask = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.gateway = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_alt_client_id = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_dns = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_learn_iqn = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_vendor_id_state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_vendor_id = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.dhcp_slp_da = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.fragmentation = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.gratuitous_arp = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.incoming_forwarding = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.tos_state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.tos = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.ttl = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.delayed_ack = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.tcp_nagle = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.tcp_wsf_state = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.tcp_wsf = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.tcp_timer_scale = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.tcp_timestamp = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.redirect = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.def_task_mgmt_timeout = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.header_digest = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.data_digest = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.immediate_data = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.initial_r2t = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.data_seq_inorder = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.data_pdu_inorder = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.erl = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.max_receive_data_len = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.first_burst_len = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.max_outstanding_r2t = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.max_burst_len = 0
Nov 15 05:42:52 user nova-compute[75648]: iface.chap_auth = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.bidi_chap = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.strict_login_compliance = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.discovery_auth = <empty>
Nov 15 05:42:52 user nova-compute[75648]: iface.discovery_logout = <empty>
Nov 15 05:42:52 user nova-compute[75648]: node.discovery_address = <empty>
Nov 15 05:42:52 user nova-compute[75648]: node.discovery_port = 0
Nov 15 05:42:52 user nova-compute[75648]: node.discovery_type = static
Nov 15 05:42:52 user nova-compute[75648]: node.session.initial_cmdsn = 0
Nov 15 05:42:52 user nova-compute[75648]: node.session.initial_login_retry_max = 8
Nov 15 05:42:52 user nova-compute[75648]: node.session.xmit_thread_priority = -20
Nov 15 05:42:52 user nova-compute[75648]: node.session.cmds_max = 128
Nov 15 05:42:52 user nova-compute[75648]: node.session.queue_depth = 32
Nov 15 05:42:52 user nova-compute[75648]: node.session.nr_sessions = 1
Nov 15 05:42:52 user nova-compute[75648]: node.session.auth.authmethod = CHAP
Nov 15 05:42:52 user nova-compute[75648]: node.session.auth.username = rLzRGfBD
Nov 15 05:42:52 user nova-compute[75648]: node.session.auth.password = ***
Nov 15 05:42:52 user nova-compute[75648]: node.session.auth.username_in = <empty>
Nov 15 05:42:52 user nova-compute[75648]: node.session.auth.password_in = <empty>
Nov 15 05:42:52 user nova-compute[75648]: node.session.auth.chap_algs = MD5
Nov 15 05:42:52 user nova-compute[75648]: node.session.timeo.replacement_timeout = 120
Nov 15 05:42:52 user nova-compute[75648]: node.session.err_timeo.abort_timeout = 15
Nov 15 05:42:52 user nova-compute[75648]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 05:42:52 user nova-compute[75648]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 05:42:52 user nova-compute[75648]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.FastAbort = Yes
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.InitialR2T = No
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.ImmediateData = Yes
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.MaxConnections = 1
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 05:42:52 user nova-compute[75648]: node.session.iscsi.ERL = 0
Nov 15 05:42:52 user nova-compute[75648]: node.session.scan = manual
Nov 15 05:42:52 user nova-compute[75648]: node.session.reopen_max = 0
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].address = 172.16.0.220
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].port = 3260
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].startup = manual
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].tcp.window_size = 524288
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].tcp.type_of_service = 0
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].timeo.logout_timeout = 15
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].timeo.login_timeout = 15
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].timeo.auth_timeout = 45
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].iscsi.DataDigest = None
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].iscsi.IFMarker = No
Nov 15 05:42:52 user nova-compute[75648]: node.conn[0].iscsi.OFMarker = No
Nov 15 05:42:52 user nova-compute[75648]: # END RECORD
Nov 15 05:42:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0d5db9-adce-4091-8b77-4fcff728dc7c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f8a95-10b0-487e-8d2e-2a26e751d9e6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLzRGfBD {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLzRGfBD" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9be60b1-6f67-45b1-975c-d319558c8dab]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLzRGfBD'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3abcdd2-9036-41e7-a22a-27c29fdc3d67]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "bec705b70844698fe08baa474216d6abd4b050a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "bec705b70844698fe08baa474216d6abd4b050a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[646c112b-1cd6-4dbe-93a5-173f617ff8f3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:52 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:52 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:52 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:52 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] HCTL ('35', '0', '0', 0) found on session 16 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b21867-acd0-42e3-aefb-a18a0fdeeceb]: (4, ('0 0 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Searching for a device in session 16 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLzRGfBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.284s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] <== connect_volume: return (285ms) {'type': 'block', 'scsi_wwn': '23066373131623865', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066373131623865', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 --force-share --output=json" returned: 0 in 0.206s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9,backing_fmt=raw /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1707185365',display_name='tempest-ServerStableDeviceRescueTest-server-1707185365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1707185365',id=6,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7aCTB5xjLY8XRjEpsG5GPRei5HEfsSRDUaCLpKUzHWbT09vztqUYj9SGGreBtI+e/RPowDdLYQ0T/VofNNn174OW4JXawjcCPrNhyPxrBGohTsKIelmdMVhsrt0FPmg==',key_name='tempest-keypair-356891063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='774de78f8d8b498d8b67c7c7d439eb6f',ramdisk_id='',reservation_id='r-tdwwieo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1094356752',owner_user_name='tempest-ServerStableDeviceRescueTest-1094356752-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:40:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221c346b396e424a8b56b182afbb77d9',uuid=fec7ed02-51fe-46d6-9d59-e6e21cb56e4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "vif_mac": "fa:16:3e:4c:49:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converting VIF {"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "vif_mac": "fa:16:3e:4c:49:4e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'pci_devices' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.968s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9,backing_fmt=raw /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk 1073741824" returned: 0 in 0.081s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "bec705b70844698fe08baa474216d6abd4b050a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.base [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Object Instance<fec7ed02-51fe-46d6-9d59-e6e21cb56e4c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:42:52 user nova-compute[75648]:   <uuid>fec7ed02-51fe-46d6-9d59-e6e21cb56e4c</uuid>
Nov 15 05:42:52 user nova-compute[75648]:   <name>instance-00000006</name>
Nov 15 05:42:52 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:42:52 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:42:52 user nova-compute[75648]:   <metadata>
Nov 15 05:42:52 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:42:52 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:42:52 user nova-compute[75648]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1707185365</nova:name>
Nov 15 05:42:52 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:42:52</nova:creationTime>
Nov 15 05:42:52 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:42:52 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:42:52 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:42:52 user nova-compute[75648]:       <nova:owner>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:user uuid="221c346b396e424a8b56b182afbb77d9">tempest-ServerStableDeviceRescueTest-1094356752-project-member</nova:user>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:project uuid="774de78f8d8b498d8b67c7c7d439eb6f">tempest-ServerStableDeviceRescueTest-1094356752</nova:project>
Nov 15 05:42:52 user nova-compute[75648]:       </nova:owner>
Nov 15 05:42:52 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:42:52 user nova-compute[75648]:       <nova:ports>
Nov 15 05:42:52 user nova-compute[75648]:         <nova:port uuid="c780fe40-bbb3-4c6c-96c8-066f066fe06a">
Nov 15 05:42:52 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:42:52 user nova-compute[75648]:         </nova:port>
Nov 15 05:42:52 user nova-compute[75648]:       </nova:ports>
Nov 15 05:42:52 user nova-compute[75648]:     </nova:instance>
Nov 15 05:42:52 user nova-compute[75648]:   </metadata>
Nov 15 05:42:52 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:42:52 user nova-compute[75648]:     <system>
Nov 15 05:42:52 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:42:52 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:42:52 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:42:52 user nova-compute[75648]:       <entry name="serial">fec7ed02-51fe-46d6-9d59-e6e21cb56e4c</entry>
Nov 15 05:42:52 user nova-compute[75648]:       <entry name="uuid">fec7ed02-51fe-46d6-9d59-e6e21cb56e4c</entry>
Nov 15 05:42:52 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:42:52 user nova-compute[75648]:     </system>
Nov 15 05:42:52 user nova-compute[75648]:   </sysinfo>
Nov 15 05:42:52 user nova-compute[75648]:   <os>
Nov 15 05:42:52 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:42:52 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:42:52 user nova-compute[75648]:   </os>
Nov 15 05:42:52 user nova-compute[75648]:   <features>
Nov 15 05:42:52 user nova-compute[75648]:     <acpi/>
Nov 15 05:42:52 user nova-compute[75648]:     <apic/>
Nov 15 05:42:52 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:42:52 user nova-compute[75648]:   </features>
Nov 15 05:42:52 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:42:52 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:42:52 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:42:52 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:42:52 user nova-compute[75648]:   </clock>
Nov 15 05:42:52 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:42:52 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:42:52 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:42:52 user nova-compute[75648]:   </cpu>
Nov 15 05:42:52 user nova-compute[75648]:   <devices>
Nov 15 05:42:52 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:42:52 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:42:52 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk"/>
Nov 15 05:42:52 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:42:52 user nova-compute[75648]:     </disk>
Nov 15 05:42:52 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:42:52 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:42:52 user nova-compute[75648]:       <source dev="/dev/sdd"/>
Nov 15 05:42:52 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:42:52 user nova-compute[75648]:       <serial>dc9a592b-3819-402e-ac1c-cca273cc1626</serial>
Nov 15 05:42:52 user nova-compute[75648]:     </disk>
Nov 15 05:42:52 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:42:52 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:42:52 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue"/>
Nov 15 05:42:52 user nova-compute[75648]:       <target dev="vdc" bus="virtio"/>
Nov 15 05:42:52 user nova-compute[75648]:       <boot order="1"/>
Nov 15 05:42:52 user nova-compute[75648]:     </disk>
Nov 15 05:42:52 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:42:52 user nova-compute[75648]:       <mac address="fa:16:3e:4c:49:4e"/>
Nov 15 05:42:52 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:52 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:42:52 user nova-compute[75648]:       <target dev="tapc780fe40-bb"/>
Nov 15 05:42:52 user nova-compute[75648]:     </interface>
Nov 15 05:42:52 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:42:52 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/console.log" append="off"/>
Nov 15 05:42:52 user nova-compute[75648]:     </serial>
Nov 15 05:42:52 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:42:52 user nova-compute[75648]:     <video>
Nov 15 05:42:52 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:52 user nova-compute[75648]:     </video>
Nov 15 05:42:52 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:42:52 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:42:52 user nova-compute[75648]:     </rng>
Nov 15 05:42:52 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:42:52 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:42:52 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:42:52 user nova-compute[75648]:     </memballoon>
Nov 15 05:42:52 user nova-compute[75648]:   </devices>
Nov 15 05:42:52 user nova-compute[75648]: </domain>
Nov 15 05:42:52 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:42:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:42:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance destroyed successfully.
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 --force-share --output=json" returned: 0 in 0.209s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'migration_context' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.policy [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4ae7fdd74e664596ab1a323e9c9347a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79b50966fa1c4fd78b0a555cb3afffee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] No VIF found with MAC fa:16:3e:4c:49:4e, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.objects.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<4d78e23e-b1d9-4395-9885-c515e558f673> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Rebasing disk image.
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:42:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Creating image(s)
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "/opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "/opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "e078624bf5c769691f29ddf28b205ad2fb871894" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "e078624bf5c769691f29ddf28b205ad2fb871894" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a -F raw /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Successfully created port: c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 1.014s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG nova.virt.images [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] c4947b38-9e55-4a7d-9e35-783fefba850e was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.part /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.part /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.converted" returned: 0 in 0.369s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-18aa28be-e856-4bd9-ae71-149e7a21824f req-13ae15b1-0fb7-4068-8708-8332ac09f640 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-18aa28be-e856-4bd9-ae71-149e7a21824f req-13ae15b1-0fb7-4068-8708-8332ac09f640 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-18aa28be-e856-4bd9-ae71-149e7a21824f req-13ae15b1-0fb7-4068-8708-8332ac09f640 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-18aa28be-e856-4bd9-ae71-149e7a21824f req-13ae15b1-0fb7-4068-8708-8332ac09f640 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-18aa28be-e856-4bd9-ae71-149e7a21824f req-13ae15b1-0fb7-4068-8708-8332ac09f640 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:54 user nova-compute[75648]: WARNING nova.compute.manager [req-18aa28be-e856-4bd9-ae71-149e7a21824f req-13ae15b1-0fb7-4068-8708-8332ac09f640 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state active and task_state rescuing.
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894.converted --force-share --output=json" returned: 0 in 0.286s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "e078624bf5c769691f29ddf28b205ad2fb871894" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.801s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Successfully updated port: c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-changed-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Refreshing instance network info cache due to event network-changed-c521ce3a-2c60-4c74-a3ce-ca8a2b194064. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] Acquiring lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] Acquired lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Refreshing network info cache for port c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 --force-share --output=json" returned: 0 in 0.274s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "e078624bf5c769691f29ddf28b205ad2fb871894" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "e078624bf5c769691f29ddf28b205ad2fb871894" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.515s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 --force-share --output=json" returned: 0 in 0.406s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894,backing_fmt=raw /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-af1acfff-533c-4062-8880-74b2898e38f7 req-f094dac3-8c0b-46c4-ad92-657595067c54 service nova] Releasing lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquired lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a -F raw /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk" returned: 0 in 2.638s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Ensure instance console log exists: /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Start _get_guest_xml network_info=[{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='cf5256f6536ddec3978c029e6c86f28e',container_format='bare',created_at=2023-11-15T05:40:47Z,direct_url=<?>,disk_format='qcow2',id=f031c544-e1ea-41aa-9052-24b4aac8d2f3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-66321000-shelved',owner='a08f06fc4de745b589b4db3c2147e43d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T05:40:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '27a331b0-2ef1-4aa4-a4ae-eace93fff08d', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgLcPznr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4d78e23e-b1d9-4395-9885-c515e558f673', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0cd44d8-8f7f-4813-8c17-c1430067b14d', 'serial': 'c0cd44d8-8f7f-4813-8c17-c1430067b14d'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894,backing_fmt=raw /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk 1073741824" returned: 0 in 0.345s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "e078624bf5c769691f29ddf28b205ad2fb871894" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.757s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:56 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cf5256f6536ddec3978c029e6c86f28e',container_format='bare',created_at=2023-11-15T05:40:47Z,direct_url=<?>,disk_format='qcow2',id=f031c544-e1ea-41aa-9052-24b4aac8d2f3,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-66321000-shelved',owner='a08f06fc4de745b589b4db3c2147e43d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T05:40:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 --force-share --output=json" returned: 0 in 0.750s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.objects.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<4d78e23e-b1d9-4395-9885-c515e558f673> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgLcPznr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:42:56 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:56 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:42:56 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Ensure instance console log exists: /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-af5748e9-61e0-4866-b14e-29bf643d787f req-b6d6b408-afb7-406a-8a3e-530b146db6d4 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-af5748e9-61e0-4866-b14e-29bf643d787f req-b6d6b408-afb7-406a-8a3e-530b146db6d4 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-af5748e9-61e0-4866-b14e-29bf643d787f req-b6d6b408-afb7-406a-8a3e-530b146db6d4 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-af5748e9-61e0-4866-b14e-29bf643d787f req-b6d6b408-afb7-406a-8a3e-530b146db6d4 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-af5748e9-61e0-4866-b14e-29bf643d787f req-b6d6b408-afb7-406a-8a3e-530b146db6d4 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:56 user nova-compute[75648]: WARNING nova.compute.manager [req-af5748e9-61e0-4866-b14e-29bf643d787f req-b6d6b408-afb7-406a-8a3e-530b146db6d4 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state active and task_state rescuing.
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:56 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:56 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7835MB free_disk=25.420639038085938GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260" returned: 21 in 0.036s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[99869ae6-1056-4c42-82ea-4134b36bc066]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:42:56 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd03cbd0-7447-48cf-b739-259d0614c393]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d] added
Nov 15 05:42:56 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d7360f-f577-448c-a9e4-46f275becffe]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4979e635-9aac-4e61-ac73-4eebeb0b9eaa]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgLcPznr {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZgLcPznr" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f7eb87-2221-4a6a-b8d8-fa81e4404d13]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZgLcPznr'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bceac5-dbe9-4fd6-b258-20adf43d8ecf]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c0d5e58b-f341-43bc-bfd4-e59eec2c1064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cd824673-df28-499e-8fa7-008d97468407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (2afde26c-116f-40d4-b607-8ec699f44de3): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b791d0b9-f7a2-4f3a-9ba5-8bc4648d0eb4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updating instance_info_cache with network_info: [{"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Releasing lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Instance network_info: |[{"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Start _get_guest_xml network_info=[{"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='5e2da9a90337bd999a081155e1fbb686',container_format='bare',created_at=2023-11-15T05:42:41Z,direct_url=<?>,disk_format='qcow2',id=c4947b38-9e55-4a7d-9e35-783fefba850e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-128158474',owner='79b50966fa1c4fd78b0a555cb3afffee',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T05:42:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'c4947b38-9e55-4a7d-9e35-783fefba850e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:42:57 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:57 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5034b8a-a85f-41df-a950-1c3783c9a07c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260]
Nov 15 05:42:57 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260] successful.
Nov 15 05:42:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='5e2da9a90337bd999a081155e1fbb686',container_format='bare',created_at=2023-11-15T05:42:41Z,direct_url=<?>,disk_format='qcow2',id=c4947b38-9e55-4a7d-9e35-783fefba850e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-128158474',owner='79b50966fa1c4fd78b0a555cb3afffee',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-15T05:42:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-175056000',display_name='tempest-TestStampPattern-server-175056000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-175056000',id=17,image_ref='c4947b38-9e55-4a7d-9e35-783fefba850e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoS16Y3HpfD0rY8HR4haBL7SzdPRoe0noXJF12ixXptNi3aAgE2AkkZArlpCa0FKKxvIhR6Hm0dXnO+kB90zMOmyhlZh1WRdqxONLK1loWH9Oj0yK5VWXCMdaCm6WMDVQ==',key_name='tempest-TestStampPattern-833870012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b50966fa1c4fd78b0a555cb3afffee',ramdisk_id='',reservation_id='r-92wweo69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1c801b45-ec7e-4f10-9443-6ab54528ab70',image_min_disk='1',image_min_ram='0',image_owner_id='79b50966fa1c4fd78b0a555cb3afffee',image_owner_project_name='tempest-TestStampPattern-591482588',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-591482588-project-member',image_user_id='4ae7fdd74e664596ab1a323e9c9347a5',network_allocated='True',owner_project_name='tempest-TestStampPattern-591482588',owner_user_name='tempest-TestStampPattern-591482588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:53Z,user_data=None,user_id='4ae7fdd74e664596ab1a323e9c9347a5',uuid=c2490dcd-e0e6-4032-9b61-72d32a1f5c8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converting VIF {"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'pci_devices' on Instance uuid c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6969b2ee-f304-451f-aeee-429fd39c231b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:42:57 user nova-compute[75648]:   <uuid>c2490dcd-e0e6-4032-9b61-72d32a1f5c8f</uuid>
Nov 15 05:42:57 user nova-compute[75648]:   <name>instance-00000011</name>
Nov 15 05:42:57 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:42:57 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:42:57 user nova-compute[75648]:   <metadata>
Nov 15 05:42:57 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:42:57 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:42:57 user nova-compute[75648]:       <nova:name>tempest-TestStampPattern-server-175056000</nova:name>
Nov 15 05:42:57 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:42:57</nova:creationTime>
Nov 15 05:42:57 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:42:57 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:42:57 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:42:57 user nova-compute[75648]:       <nova:owner>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:user uuid="4ae7fdd74e664596ab1a323e9c9347a5">tempest-TestStampPattern-591482588-project-member</nova:user>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:project uuid="79b50966fa1c4fd78b0a555cb3afffee">tempest-TestStampPattern-591482588</nova:project>
Nov 15 05:42:57 user nova-compute[75648]:       </nova:owner>
Nov 15 05:42:57 user nova-compute[75648]:       <nova:root type="image" uuid="c4947b38-9e55-4a7d-9e35-783fefba850e"/>
Nov 15 05:42:57 user nova-compute[75648]:       <nova:ports>
Nov 15 05:42:57 user nova-compute[75648]:         <nova:port uuid="c521ce3a-2c60-4c74-a3ce-ca8a2b194064">
Nov 15 05:42:57 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 15 05:42:57 user nova-compute[75648]:         </nova:port>
Nov 15 05:42:57 user nova-compute[75648]:       </nova:ports>
Nov 15 05:42:57 user nova-compute[75648]:     </nova:instance>
Nov 15 05:42:57 user nova-compute[75648]:   </metadata>
Nov 15 05:42:57 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:42:57 user nova-compute[75648]:     <system>
Nov 15 05:42:57 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:42:57 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:42:57 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:42:57 user nova-compute[75648]:       <entry name="serial">c2490dcd-e0e6-4032-9b61-72d32a1f5c8f</entry>
Nov 15 05:42:57 user nova-compute[75648]:       <entry name="uuid">c2490dcd-e0e6-4032-9b61-72d32a1f5c8f</entry>
Nov 15 05:42:57 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:42:57 user nova-compute[75648]:     </system>
Nov 15 05:42:57 user nova-compute[75648]:   </sysinfo>
Nov 15 05:42:57 user nova-compute[75648]:   <os>
Nov 15 05:42:57 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:42:57 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:42:57 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:42:57 user nova-compute[75648]:   </os>
Nov 15 05:42:57 user nova-compute[75648]:   <features>
Nov 15 05:42:57 user nova-compute[75648]:     <acpi/>
Nov 15 05:42:57 user nova-compute[75648]:     <apic/>
Nov 15 05:42:57 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:42:57 user nova-compute[75648]:   </features>
Nov 15 05:42:57 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:42:57 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:42:57 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:42:57 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:42:57 user nova-compute[75648]:   </clock>
Nov 15 05:42:57 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:42:57 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:42:57 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:42:57 user nova-compute[75648]:   </cpu>
Nov 15 05:42:57 user nova-compute[75648]:   <devices>
Nov 15 05:42:57 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:42:57 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:42:57 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk"/>
Nov 15 05:42:57 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:42:57 user nova-compute[75648]:     </disk>
Nov 15 05:42:57 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:42:57 user nova-compute[75648]:       <mac address="fa:16:3e:7a:8b:2b"/>
Nov 15 05:42:57 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:57 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:42:57 user nova-compute[75648]:       <target dev="tapc521ce3a-2c"/>
Nov 15 05:42:57 user nova-compute[75648]:     </interface>
Nov 15 05:42:57 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:42:57 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/console.log" append="off"/>
Nov 15 05:42:57 user nova-compute[75648]:     </serial>
Nov 15 05:42:57 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:42:57 user nova-compute[75648]:     <video>
Nov 15 05:42:57 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:57 user nova-compute[75648]:     </video>
Nov 15 05:42:57 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:42:57 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:42:57 user nova-compute[75648]:     </rng>
Nov 15 05:42:57 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:42:57 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:42:57 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:42:57 user nova-compute[75648]:     </memballoon>
Nov 15 05:42:57 user nova-compute[75648]:   </devices>
Nov 15 05:42:57 user nova-compute[75648]: </domain>
Nov 15 05:42:57 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-175056000',display_name='tempest-TestStampPattern-server-175056000',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-175056000',id=17,image_ref='c4947b38-9e55-4a7d-9e35-783fefba850e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoS16Y3HpfD0rY8HR4haBL7SzdPRoe0noXJF12ixXptNi3aAgE2AkkZArlpCa0FKKxvIhR6Hm0dXnO+kB90zMOmyhlZh1WRdqxONLK1loWH9Oj0yK5VWXCMdaCm6WMDVQ==',key_name='tempest-TestStampPattern-833870012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='79b50966fa1c4fd78b0a555cb3afffee',ramdisk_id='',reservation_id='r-92wweo69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1c801b45-ec7e-4f10-9443-6ab54528ab70',image_min_disk='1',image_min_ram='0',image_owner_id='79b50966fa1c4fd78b0a555cb3afffee',image_owner_project_name='tempest-TestStampPattern-591482588',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-591482588-project-member',image_user_id='4ae7fdd74e664596ab1a323e9c9347a5',network_allocated='True',owner_project_name='tempest-TestStampPattern-591482588',owner_user_name='tempest-TestStampPattern-591482588-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:53Z,user_data=None,user_id='4ae7fdd74e664596ab1a323e9c9347a5',uuid=c2490dcd-e0e6-4032-9b61-72d32a1f5c8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converting VIF {"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_vif [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a746e71-3bbe-46b3-b09d-9001d52f4741]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96df2072-7c5c-564a-b49d-40a0814d6fce', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:42:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:42:57 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:42:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.359s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] HCTL ('36', '-', '-', 0) found on session 17 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc521ce3a-2c, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc521ce3a-2c, col_values=(('qos', UUID('434e990a-2a45-4c5c-b1ed-45419cb9f49c')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc521ce3a-2c, col_values=(('external_ids', {'iface-id': 'c521ce3a-2c60-4c74-a3ce-ca8a2b194064', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:8b:2b', 'vm-uuid': 'c2490dcd-e0e6-4032-9b61-72d32a1f5c8f'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: INFO os_vif [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c')
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d76b33-b777-402c-84d0-46e0013a7f32]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching for a device in session 17 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgLcPznr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No VIF found with MAC fa:16:3e:7a:8b:2b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.640s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:57 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d1e2824b-ac77-466b-b93f-70e32d4efabd tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] <== connect_volume: return (1406ms) {'type': 'block', 'scsi_wwn': '23333383939313439', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333383939313439', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-66321000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-66321000',id=4,image_ref='f031c544-e1ea-41aa-9052-24b4aac8d2f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2114855632',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-0dc600ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member',shelved_at='2023-11-15T05:40:53.341694',shelved_host='user',shelved_image_id='f031c544-e1ea-41aa-9052-24b4aac8d2f3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=4d78e23e-b1d9-4395-9885-c515e558f673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'pci_devices' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.objects.base [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<4d78e23e-b1d9-4395-9885-c515e558f673> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:42:58 user nova-compute[75648]:   <uuid>4d78e23e-b1d9-4395-9885-c515e558f673</uuid>
Nov 15 05:42:58 user nova-compute[75648]:   <name>instance-00000004</name>
Nov 15 05:42:58 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:42:58 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:42:58 user nova-compute[75648]:   <metadata>
Nov 15 05:42:58 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:42:58 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:42:58 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-66321000</nova:name>
Nov 15 05:42:58 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:42:56</nova:creationTime>
Nov 15 05:42:58 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:42:58 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:42:58 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:42:58 user nova-compute[75648]:       <nova:owner>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:user uuid="8bd09324c4634b8b820c49b51752a688">tempest-AttachVolumeShelveTestJSON-1500760960-project-member</nova:user>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:project uuid="a08f06fc4de745b589b4db3c2147e43d">tempest-AttachVolumeShelveTestJSON-1500760960</nova:project>
Nov 15 05:42:58 user nova-compute[75648]:       </nova:owner>
Nov 15 05:42:58 user nova-compute[75648]:       <nova:root type="image" uuid="f031c544-e1ea-41aa-9052-24b4aac8d2f3"/>
Nov 15 05:42:58 user nova-compute[75648]:       <nova:ports>
Nov 15 05:42:58 user nova-compute[75648]:         <nova:port uuid="f91e5406-2b2a-45e8-86a4-81edc6a8a06f">
Nov 15 05:42:58 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:42:58 user nova-compute[75648]:         </nova:port>
Nov 15 05:42:58 user nova-compute[75648]:       </nova:ports>
Nov 15 05:42:58 user nova-compute[75648]:     </nova:instance>
Nov 15 05:42:58 user nova-compute[75648]:   </metadata>
Nov 15 05:42:58 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:42:58 user nova-compute[75648]:     <system>
Nov 15 05:42:58 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:42:58 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:42:58 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:42:58 user nova-compute[75648]:       <entry name="serial">4d78e23e-b1d9-4395-9885-c515e558f673</entry>
Nov 15 05:42:58 user nova-compute[75648]:       <entry name="uuid">4d78e23e-b1d9-4395-9885-c515e558f673</entry>
Nov 15 05:42:58 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:42:58 user nova-compute[75648]:     </system>
Nov 15 05:42:58 user nova-compute[75648]:   </sysinfo>
Nov 15 05:42:58 user nova-compute[75648]:   <os>
Nov 15 05:42:58 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:42:58 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:42:58 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:42:58 user nova-compute[75648]:   </os>
Nov 15 05:42:58 user nova-compute[75648]:   <features>
Nov 15 05:42:58 user nova-compute[75648]:     <acpi/>
Nov 15 05:42:58 user nova-compute[75648]:     <apic/>
Nov 15 05:42:58 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:42:58 user nova-compute[75648]:   </features>
Nov 15 05:42:58 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:42:58 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:42:58 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:42:58 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:42:58 user nova-compute[75648]:   </clock>
Nov 15 05:42:58 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:42:58 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:42:58 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:42:58 user nova-compute[75648]:   </cpu>
Nov 15 05:42:58 user nova-compute[75648]:   <devices>
Nov 15 05:42:58 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:42:58 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:42:58 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk"/>
Nov 15 05:42:58 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:42:58 user nova-compute[75648]:     </disk>
Nov 15 05:42:58 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:42:58 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:42:58 user nova-compute[75648]:       <source dev="/dev/sde"/>
Nov 15 05:42:58 user nova-compute[75648]:       <target dev="vdc" bus="virtio"/>
Nov 15 05:42:58 user nova-compute[75648]:       <serial>c0cd44d8-8f7f-4813-8c17-c1430067b14d</serial>
Nov 15 05:42:58 user nova-compute[75648]:     </disk>
Nov 15 05:42:58 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:42:58 user nova-compute[75648]:       <mac address="fa:16:3e:ad:9b:17"/>
Nov 15 05:42:58 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:58 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:42:58 user nova-compute[75648]:       <target dev="tapf91e5406-2b"/>
Nov 15 05:42:58 user nova-compute[75648]:     </interface>
Nov 15 05:42:58 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:42:58 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/console.log" append="off"/>
Nov 15 05:42:58 user nova-compute[75648]:     </serial>
Nov 15 05:42:58 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:42:58 user nova-compute[75648]:     <video>
Nov 15 05:42:58 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:42:58 user nova-compute[75648]:     </video>
Nov 15 05:42:58 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:42:58 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:42:58 user nova-compute[75648]:     </rng>
Nov 15 05:42:58 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:42:58 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:42:58 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:42:58 user nova-compute[75648]:     </memballoon>
Nov 15 05:42:58 user nova-compute[75648]:   </devices>
Nov 15 05:42:58 user nova-compute[75648]: </domain>
Nov 15 05:42:58 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-66321000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-66321000',id=4,image_ref='f031c544-e1ea-41aa-9052-24b4aac8d2f3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-2114855632',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-0dc600ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member',shelved_at='2023-11-15T05:40:53.341694',shelved_host='user',shelved_image_id='f031c544-e1ea-41aa-9052-24b4aac8d2f3'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=4d78e23e-b1d9-4395-9885-c515e558f673,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG os_vif [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddd42c3d-9b64-5e26-96c5-8c24af25d483', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf91e5406-2b, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf91e5406-2b, col_values=(('qos', UUID('e02e919c-04f4-4c0b-ab35-599e60241f26')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf91e5406-2b, col_values=(('external_ids', {'iface-id': 'f91e5406-2b2a-45e8-86a4-81edc6a8a06f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:9b:17', 'vm-uuid': '4d78e23e-b1d9-4395-9885-c515e558f673'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: INFO os_vif [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b')
Nov 15 05:42:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No VIF found with MAC fa:16:3e:ad:9b:17, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [{"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-4d78e23e-b1d9-4395-9885-c515e558f673" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-fe4db17c-9d12-4752-9852-15f91821adf0 req-71060cae-feb0-4431-9a1e-762e5d2463f3 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fe4db17c-9d12-4752-9852-15f91821adf0 req-71060cae-feb0-4431-9a1e-762e5d2463f3 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fe4db17c-9d12-4752-9852-15f91821adf0 req-71060cae-feb0-4431-9a1e-762e5d2463f3 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fe4db17c-9d12-4752-9852-15f91821adf0 req-71060cae-feb0-4431-9a1e-762e5d2463f3 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:42:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-fe4db17c-9d12-4752-9852-15f91821adf0 req-71060cae-feb0-4431-9a1e-762e5d2463f3 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:42:59 user nova-compute[75648]: WARNING nova.compute.manager [req-fe4db17c-9d12-4752-9852-15f91821adf0 req-71060cae-feb0-4431-9a1e-762e5d2463f3 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state building and task_state spawning.
Nov 15 05:43:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:01 user nova-compute[75648]: WARNING nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state building and task_state spawning.
Nov 15 05:43:01 user nova-compute[75648]: DEBUG nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:01 user nova-compute[75648]: WARNING nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 05:43:01 user nova-compute[75648]: DEBUG nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:01 user nova-compute[75648]: WARNING nova.compute.manager [req-9cfcfdd5-2572-43df-b022-f64f612040b6 req-44246ecf-99e5-42f0-a73e-64aa63073502 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 05:43:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:43:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Instance spawned successfully.
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:02 user nova-compute[75648]: INFO nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Took 9.43 seconds to spawn the instance on the hypervisor.
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:02 user nova-compute[75648]: INFO nova.compute.manager [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Took 11.08 seconds to build instance.
Nov 15 05:43:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f2c24b28-da20-4eb9-b165-1a9152e9a1da tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.249s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:43:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:43:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance spawned successfully.
Nov 15 05:43:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1ac6b249-e158-4dab-9080-98853196fd0f tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.108s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:43:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:43:22 user nova-compute[75648]: INFO nova.compute.claims [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Claim successful on node user
Nov 15 05:43:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.836s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.network.neutron [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:43:22 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:43:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:43:23 user nova-compute[75648]: INFO nova.virt.block_device [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Booting with volume 6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f at /dev/vda
Nov 15 05:43:23 user nova-compute[75648]: DEBUG nova.policy [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd4a8513df14fc7ab09905d24220ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea832b577b9445782f27e28b1023e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG os_brick.utils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5a6d4e-e6a1-4bb2-b5c4-32b5c55652b3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbaadce-5304-44b0-bb20-0a7ca0e1405a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf25b19-3438-46ce-8cf9-1662971939e6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4494b87-bc9b-4805-b2ff-f42306dc9d2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:43:23 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:43:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c042684c-2b1a-4355-8032-cd425861c989]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG os_brick.utils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updating existing volume attachment record: 7ca3db42-765e-431e-b491-c3656fcf1983 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:23 user nova-compute[75648]: DEBUG nova.network.neutron [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Successfully created port: a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Successfully updated port: a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquired lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-changed-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Refreshing instance network info cache due to event network-changed-a6126e35-cf95-47e8-8898-48be16256eb2. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] Acquiring lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updating instance_info_cache with network_info: [{"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Releasing lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Instance network_info: |[{"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] Acquired lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Refreshing network info cache for port a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updated VIF entry in instance network info cache for port a6126e35-cf95-47e8-8898-48be16256eb2. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updating instance_info_cache with network_info: [{"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4ed21575-8525-487e-bd19-160626a02958 req-a1c19712-a7cd-4a3e-951d-ffd2dce09e13 service nova] Releasing lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:43:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Creating image(s)
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Ensure instance console log exists: /opt/stack/data/nova/instances/d2e87c21-9cc6-43c2-a954-ba12eec2b0ee/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Start _get_guest_xml network_info=[{"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '7ca3db42-765e-431e-b491-c3656fcf1983', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEwJfbrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2e87c21-9cc6-43c2-a954-ba12eec2b0ee', 'attached_at': '', 'detached_at': '', 'volume_id': '6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f', 'serial': '6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:43:29 user nova-compute[75648]: INFO nova.compute.claims [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Claim successful on node user
Nov 15 05:43:29 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:29 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEwJfbrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:43:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:43:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:43:29 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec662c8-14a4-4ec2-af8e-e27e125b0a7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:43:29 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[059156f3-148f-4f86-bea2-459fb340024f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f] added
Nov 15 05:43:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934af73-afe7-474c-aadb-8539d9aaf1fc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[818dbb79-7531-4436-85d5-f5eae0e61166]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tEwJfbrz {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tEwJfbrz" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[854665b3-8af3-4ef8-b074-29fc25bcfeff]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tEwJfbrz'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f39b638-1307-4065-83e6-da750a7e3409]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30cd337-096c-4ac7-aff6-b10913659475]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c05e9f-fa46-46ce-9183-7296ff8ac437]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260]
Nov 15 05:43:29 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260] successful.
Nov 15 05:43:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a18eaaab-6522-4cd5-ad1b-2f4cf5994b5d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6026c7f-1b89-4a81-b535-f2eea211db16]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:43:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:29 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:43:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] HCTL ('37', '-', '-', 0) found on session 18 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6739d15e-eb14-4ce1-988f-dd7e507495b0]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:43:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.policy [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0aa1627a1bf4e0abc6618d6ecbe5944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd3f0cb9d1048e899c02994b977bec3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:43:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Creating image(s)
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "54d4d3c81643b7564f83b31eaa0ad845531e9027" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "54d4d3c81643b7564f83b31eaa0ad845531e9027" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 18 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEwJfbrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.440s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '26236363166376238', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:43:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236363166376238', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-838863928',display_name='tempest-TestVolumeBootPattern-volume-backed-server-838863928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-838863928',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXH1hacaiNwUz7bs583ZdGDHSuSJzfucLuooOvXqxTHWLJsV4OKL9ceiAqwA12a1KQGRDZxGfs8mpvLouxVtPAvmkXSulmvq1HCOW0c1wI1KWlPkp6ILOvW8d1qkPI9Iw==',key_name='tempest-keypair-1928239342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-f976lf21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=d2e87c21-9cc6-43c2-a954-ba12eec2b0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.objects.instance [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'pci_devices' on Instance uuid d2e87c21-9cc6-43c2-a954-ba12eec2b0ee {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:43:31 user nova-compute[75648]:   <uuid>d2e87c21-9cc6-43c2-a954-ba12eec2b0ee</uuid>
Nov 15 05:43:31 user nova-compute[75648]:   <name>instance-00000012</name>
Nov 15 05:43:31 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:43:31 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:43:31 user nova-compute[75648]:   <metadata>
Nov 15 05:43:31 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:43:31 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:43:31 user nova-compute[75648]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-838863928</nova:name>
Nov 15 05:43:31 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:43:29</nova:creationTime>
Nov 15 05:43:31 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:43:31 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:43:31 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:43:31 user nova-compute[75648]:       <nova:owner>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:user uuid="2fd4a8513df14fc7ab09905d24220ae1">tempest-TestVolumeBootPattern-522670763-project-member</nova:user>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:project uuid="bea832b577b9445782f27e28b1023e96">tempest-TestVolumeBootPattern-522670763</nova:project>
Nov 15 05:43:31 user nova-compute[75648]:       </nova:owner>
Nov 15 05:43:31 user nova-compute[75648]:       <nova:ports>
Nov 15 05:43:31 user nova-compute[75648]:         <nova:port uuid="a6126e35-cf95-47e8-8898-48be16256eb2">
Nov 15 05:43:31 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:43:31 user nova-compute[75648]:         </nova:port>
Nov 15 05:43:31 user nova-compute[75648]:       </nova:ports>
Nov 15 05:43:31 user nova-compute[75648]:     </nova:instance>
Nov 15 05:43:31 user nova-compute[75648]:   </metadata>
Nov 15 05:43:31 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:43:31 user nova-compute[75648]:     <system>
Nov 15 05:43:31 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:43:31 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:43:31 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:43:31 user nova-compute[75648]:       <entry name="serial">d2e87c21-9cc6-43c2-a954-ba12eec2b0ee</entry>
Nov 15 05:43:31 user nova-compute[75648]:       <entry name="uuid">d2e87c21-9cc6-43c2-a954-ba12eec2b0ee</entry>
Nov 15 05:43:31 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:43:31 user nova-compute[75648]:     </system>
Nov 15 05:43:31 user nova-compute[75648]:   </sysinfo>
Nov 15 05:43:31 user nova-compute[75648]:   <os>
Nov 15 05:43:31 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:43:31 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:43:31 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:43:31 user nova-compute[75648]:   </os>
Nov 15 05:43:31 user nova-compute[75648]:   <features>
Nov 15 05:43:31 user nova-compute[75648]:     <acpi/>
Nov 15 05:43:31 user nova-compute[75648]:     <apic/>
Nov 15 05:43:31 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:43:31 user nova-compute[75648]:   </features>
Nov 15 05:43:31 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:43:31 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:43:31 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:43:31 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:43:31 user nova-compute[75648]:   </clock>
Nov 15 05:43:31 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:43:31 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:43:31 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:43:31 user nova-compute[75648]:   </cpu>
Nov 15 05:43:31 user nova-compute[75648]:   <devices>
Nov 15 05:43:31 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:43:31 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:43:31 user nova-compute[75648]:       <source dev="/dev/sdf"/>
Nov 15 05:43:31 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:43:31 user nova-compute[75648]:       <serial>6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f</serial>
Nov 15 05:43:31 user nova-compute[75648]:     </disk>
Nov 15 05:43:31 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:43:31 user nova-compute[75648]:       <mac address="fa:16:3e:82:6f:be"/>
Nov 15 05:43:31 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:31 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:43:31 user nova-compute[75648]:       <target dev="tapa6126e35-cf"/>
Nov 15 05:43:31 user nova-compute[75648]:     </interface>
Nov 15 05:43:31 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:43:31 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/d2e87c21-9cc6-43c2-a954-ba12eec2b0ee/console.log" append="off"/>
Nov 15 05:43:31 user nova-compute[75648]:     </serial>
Nov 15 05:43:31 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:43:31 user nova-compute[75648]:     <video>
Nov 15 05:43:31 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:31 user nova-compute[75648]:     </video>
Nov 15 05:43:31 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:43:31 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:43:31 user nova-compute[75648]:     </rng>
Nov 15 05:43:31 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:43:31 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:43:31 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:43:31 user nova-compute[75648]:     </memballoon>
Nov 15 05:43:31 user nova-compute[75648]:   </devices>
Nov 15 05:43:31 user nova-compute[75648]: </domain>
Nov 15 05:43:31 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-838863928',display_name='tempest-TestVolumeBootPattern-volume-backed-server-838863928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-838863928',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXH1hacaiNwUz7bs583ZdGDHSuSJzfucLuooOvXqxTHWLJsV4OKL9ceiAqwA12a1KQGRDZxGfs8mpvLouxVtPAvmkXSulmvq1HCOW0c1wI1KWlPkp6ILOvW8d1qkPI9Iw==',key_name='tempest-keypair-1928239342',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-f976lf21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=d2e87c21-9cc6-43c2-a954-ba12eec2b0ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG os_vif [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '47e3a66c-fdcf-52f7-b8ab-94d25c8404e6', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6126e35-cf, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6126e35-cf, col_values=(('qos', UUID('4f4eb29f-4968-427d-b7ab-0d11d39bfe56')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6126e35-cf, col_values=(('external_ids', {'iface-id': 'a6126e35-cf95-47e8-8898-48be16256eb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:6f:be', 'vm-uuid': 'd2e87c21-9cc6-43c2-a954-ba12eec2b0ee'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: INFO os_vif [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf')
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No VIF found with MAC fa:16:3e:82:6f:be, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.part --force-share --output=json" returned: 0 in 0.335s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.virt.images [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] e0af5aca-7cfb-4309-89cd-1fb08884ac1f was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.part /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.part /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.converted" returned: 0 in 0.293s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027.converted --force-share --output=json" returned: 0 in 0.224s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "54d4d3c81643b7564f83b31eaa0ad845531e9027" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.343s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Successfully created port: ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "54d4d3c81643b7564f83b31eaa0ad845531e9027" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "54d4d3c81643b7564f83b31eaa0ad845531e9027" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027,backing_fmt=raw /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027,backing_fmt=raw /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk 1073741824" returned: 0 in 0.051s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "54d4d3c81643b7564f83b31eaa0ad845531e9027" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json" returned: 0 in 0.267s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Cannot resize image /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Ensure instance console log exists: /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Successfully updated port: ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing instance network info cache due to event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: INFO nova.compute.manager [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Rescuing
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-9f2c68b4-c0a6-4e98-932a-0c69117f84e4 req-2e0e4f0e-4959-4ed5-b5de-ce10a8062e54 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9f2c68b4-c0a6-4e98-932a-0c69117f84e4 req-2e0e4f0e-4959-4ed5-b5de-ce10a8062e54 service nova] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9f2c68b4-c0a6-4e98-932a-0c69117f84e4 req-2e0e4f0e-4959-4ed5-b5de-ce10a8062e54 service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9f2c68b4-c0a6-4e98-932a-0c69117f84e4 req-2e0e4f0e-4959-4ed5-b5de-ce10a8062e54 service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-9f2c68b4-c0a6-4e98-932a-0c69117f84e4 req-2e0e4f0e-4959-4ed5-b5de-ce10a8062e54 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] No waiting events found dispatching network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:34 user nova-compute[75648]: WARNING nova.compute.manager [req-9f2c68b4-c0a6-4e98-932a-0c69117f84e4 req-2e0e4f0e-4959-4ed5-b5de-ce10a8062e54 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received unexpected event network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 for instance with vm_state building and task_state spawning.
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance network_info: |[{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Start _get_guest_xml network_info=[{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:43:25Z,direct_url=<?>,disk_format='qcow2',id=e0af5aca-7cfb-4309-89cd-1fb08884ac1f,min_disk=0,min_ram=0,name='tempest-scenario-img--450389940',owner='abd3f0cb9d1048e899c02994b977bec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:43:28Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e0af5aca-7cfb-4309-89cd-1fb08884ac1f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:43:34 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:34 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:43:25Z,direct_url=<?>,disk_format='qcow2',id=e0af5aca-7cfb-4309-89cd-1fb08884ac1f,min_disk=0,min_ram=0,name='tempest-scenario-img--450389940',owner='abd3f0cb9d1048e899c02994b977bec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:43:28Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1312046518',display_name='tempest-TestMinimumBasicScenario-server-1312046518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1312046518',id=19,image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI1HOtaiCSAxyXom2SzZVLqtMwnYcysv+cn0KFAKSfgS4wkwlRPGpAVRAhOmmoubEgzy8jADoPs6wnsWI3faIzmsFLbexUqVTAcCmfzrz4KjqlU2YQNohn5aMa7T+PAQg==',key_name='tempest-TestMinimumBasicScenario-973469601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ds02yl35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:30Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=40448f79-0cbc-462a-be88-050f97128a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'pci_devices' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:43:34 user nova-compute[75648]:   <uuid>40448f79-0cbc-462a-be88-050f97128a07</uuid>
Nov 15 05:43:34 user nova-compute[75648]:   <name>instance-00000013</name>
Nov 15 05:43:34 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:43:34 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:43:34 user nova-compute[75648]:   <metadata>
Nov 15 05:43:34 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:43:34 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:43:34 user nova-compute[75648]:       <nova:name>tempest-TestMinimumBasicScenario-server-1312046518</nova:name>
Nov 15 05:43:34 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:43:34</nova:creationTime>
Nov 15 05:43:34 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:43:34 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:43:34 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:43:34 user nova-compute[75648]:       <nova:owner>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:user uuid="b0aa1627a1bf4e0abc6618d6ecbe5944">tempest-TestMinimumBasicScenario-623726925-project-member</nova:user>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:project uuid="abd3f0cb9d1048e899c02994b977bec3">tempest-TestMinimumBasicScenario-623726925</nova:project>
Nov 15 05:43:34 user nova-compute[75648]:       </nova:owner>
Nov 15 05:43:34 user nova-compute[75648]:       <nova:root type="image" uuid="e0af5aca-7cfb-4309-89cd-1fb08884ac1f"/>
Nov 15 05:43:34 user nova-compute[75648]:       <nova:ports>
Nov 15 05:43:34 user nova-compute[75648]:         <nova:port uuid="ae26706e-3298-4eb3-a239-efe30a80ab1f">
Nov 15 05:43:34 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:43:34 user nova-compute[75648]:         </nova:port>
Nov 15 05:43:34 user nova-compute[75648]:       </nova:ports>
Nov 15 05:43:34 user nova-compute[75648]:     </nova:instance>
Nov 15 05:43:34 user nova-compute[75648]:   </metadata>
Nov 15 05:43:34 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:43:34 user nova-compute[75648]:     <system>
Nov 15 05:43:34 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:43:34 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:43:34 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:43:34 user nova-compute[75648]:       <entry name="serial">40448f79-0cbc-462a-be88-050f97128a07</entry>
Nov 15 05:43:34 user nova-compute[75648]:       <entry name="uuid">40448f79-0cbc-462a-be88-050f97128a07</entry>
Nov 15 05:43:34 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:43:34 user nova-compute[75648]:     </system>
Nov 15 05:43:34 user nova-compute[75648]:   </sysinfo>
Nov 15 05:43:34 user nova-compute[75648]:   <os>
Nov 15 05:43:34 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:43:34 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:43:34 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:43:34 user nova-compute[75648]:   </os>
Nov 15 05:43:34 user nova-compute[75648]:   <features>
Nov 15 05:43:34 user nova-compute[75648]:     <acpi/>
Nov 15 05:43:34 user nova-compute[75648]:     <apic/>
Nov 15 05:43:34 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:43:34 user nova-compute[75648]:   </features>
Nov 15 05:43:34 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:43:34 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:43:34 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:43:34 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:43:34 user nova-compute[75648]:   </clock>
Nov 15 05:43:34 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:43:34 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:43:34 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:43:34 user nova-compute[75648]:   </cpu>
Nov 15 05:43:34 user nova-compute[75648]:   <devices>
Nov 15 05:43:34 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:43:34 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:43:34 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk"/>
Nov 15 05:43:34 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:43:34 user nova-compute[75648]:     </disk>
Nov 15 05:43:34 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:43:34 user nova-compute[75648]:       <mac address="fa:16:3e:31:38:3b"/>
Nov 15 05:43:34 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:34 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:43:34 user nova-compute[75648]:       <target dev="tapae26706e-32"/>
Nov 15 05:43:34 user nova-compute[75648]:     </interface>
Nov 15 05:43:34 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:43:34 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/console.log" append="off"/>
Nov 15 05:43:34 user nova-compute[75648]:     </serial>
Nov 15 05:43:34 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:43:34 user nova-compute[75648]:     <video>
Nov 15 05:43:34 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:34 user nova-compute[75648]:     </video>
Nov 15 05:43:34 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:43:34 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:43:34 user nova-compute[75648]:     </rng>
Nov 15 05:43:34 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:43:34 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:43:34 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:43:34 user nova-compute[75648]:     </memballoon>
Nov 15 05:43:34 user nova-compute[75648]:   </devices>
Nov 15 05:43:34 user nova-compute[75648]: </domain>
Nov 15 05:43:34 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1312046518',display_name='tempest-TestMinimumBasicScenario-server-1312046518',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1312046518',id=19,image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI1HOtaiCSAxyXom2SzZVLqtMwnYcysv+cn0KFAKSfgS4wkwlRPGpAVRAhOmmoubEgzy8jADoPs6wnsWI3faIzmsFLbexUqVTAcCmfzrz4KjqlU2YQNohn5aMa7T+PAQg==',key_name='tempest-TestMinimumBasicScenario-973469601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ds02yl35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:30Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=40448f79-0cbc-462a-be88-050f97128a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG os_vif [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b365afd-22a5-5adb-a652-9c3dbf312ccd', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae26706e-32, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae26706e-32, col_values=(('qos', UUID('c69ea878-c5c8-4c89-819c-3c0a612acac5')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae26706e-32, col_values=(('external_ids', {'iface-id': 'ae26706e-3298-4eb3-a239-efe30a80ab1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:38:3b', 'vm-uuid': '40448f79-0cbc-462a-be88-050f97128a07'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:34 user nova-compute[75648]: INFO os_vif [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32')
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No VIF found with MAC fa:16:3e:31:38:3b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:43:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:43:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Instance spawned successfully.
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:35 user nova-compute[75648]: INFO nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updated VIF entry in instance network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3e28c108-16d7-4e32-9f73-611f790fe5db req-a25627e6-8ba7-4056-b982-91a0b84595a6 service nova] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:35 user nova-compute[75648]: INFO nova.compute.manager [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Took 13.65 seconds to build instance.
Nov 15 05:43:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-63763c73-c0a5-4a26-806a-dc797f5f072a tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.768s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] No waiting events found dispatching network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:36 user nova-compute[75648]: WARNING nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received unexpected event network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 for instance with vm_state active and task_state None.
Nov 15 05:43:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:36 user nova-compute[75648]: WARNING nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:36 user nova-compute[75648]: WARNING nova.compute.manager [req-c3d57ebc-d220-4e55-876f-8a3cbf2fdb03 req-22b6294e-2136-4faf-aa8c-f68c53749927 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance destroyed successfully.
Nov 15 05:43:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Attempting rescue
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75648) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:43:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Creating image(s)
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.223s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue" returned: 0 in 0.054s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'migration_context' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<c6859cea-129c-472b-aba0-b609ddc5f89a> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Start _get_guest_xml network_info=[{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:6a:e8:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'resources' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<c6859cea-129c-472b-aba0-b609ddc5f89a> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'numa_topology' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<c6859cea-129c-472b-aba0-b609ddc5f89a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:37 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:37 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<c6859cea-129c-472b-aba0-b609ddc5f89a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-618512900',display_name='tempest-ServerRescueNegativeTestJSON-server-618512900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-618512900',id=1,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-e00zqohb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:39:09Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=c6859cea-129c-472b-aba0-b609ddc5f89a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:6a:e8:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:6a:e8:00"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'pci_devices' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<c6859cea-129c-472b-aba0-b609ddc5f89a> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:43:37 user nova-compute[75648]:   <uuid>c6859cea-129c-472b-aba0-b609ddc5f89a</uuid>
Nov 15 05:43:37 user nova-compute[75648]:   <name>instance-00000001</name>
Nov 15 05:43:37 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:43:37 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:43:37 user nova-compute[75648]:   <metadata>
Nov 15 05:43:37 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:43:37 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:43:37 user nova-compute[75648]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-618512900</nova:name>
Nov 15 05:43:37 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:43:37</nova:creationTime>
Nov 15 05:43:37 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:43:37 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:43:37 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:43:37 user nova-compute[75648]:       <nova:owner>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:user uuid="e20600cd4fd148b1b871195e1e5397d7">tempest-ServerRescueNegativeTestJSON-1116175393-project-member</nova:user>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:project uuid="1ba132e2da344b8da008767a69ba0f3f">tempest-ServerRescueNegativeTestJSON-1116175393</nova:project>
Nov 15 05:43:37 user nova-compute[75648]:       </nova:owner>
Nov 15 05:43:37 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:43:37 user nova-compute[75648]:       <nova:ports>
Nov 15 05:43:37 user nova-compute[75648]:         <nova:port uuid="563c8454-c7b5-4d8f-9c22-a8da90b69a3a">
Nov 15 05:43:37 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 05:43:37 user nova-compute[75648]:         </nova:port>
Nov 15 05:43:37 user nova-compute[75648]:       </nova:ports>
Nov 15 05:43:37 user nova-compute[75648]:     </nova:instance>
Nov 15 05:43:37 user nova-compute[75648]:   </metadata>
Nov 15 05:43:37 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:43:37 user nova-compute[75648]:     <system>
Nov 15 05:43:37 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:43:37 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:43:37 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:43:37 user nova-compute[75648]:       <entry name="serial">c6859cea-129c-472b-aba0-b609ddc5f89a</entry>
Nov 15 05:43:37 user nova-compute[75648]:       <entry name="uuid">c6859cea-129c-472b-aba0-b609ddc5f89a</entry>
Nov 15 05:43:37 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:43:37 user nova-compute[75648]:     </system>
Nov 15 05:43:37 user nova-compute[75648]:   </sysinfo>
Nov 15 05:43:37 user nova-compute[75648]:   <os>
Nov 15 05:43:37 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:43:37 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:43:37 user nova-compute[75648]:   </os>
Nov 15 05:43:37 user nova-compute[75648]:   <features>
Nov 15 05:43:37 user nova-compute[75648]:     <acpi/>
Nov 15 05:43:37 user nova-compute[75648]:     <apic/>
Nov 15 05:43:37 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:43:37 user nova-compute[75648]:   </features>
Nov 15 05:43:37 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:43:37 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:43:37 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:43:37 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:43:37 user nova-compute[75648]:   </clock>
Nov 15 05:43:37 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:43:37 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:43:37 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:43:37 user nova-compute[75648]:   </cpu>
Nov 15 05:43:37 user nova-compute[75648]:   <devices>
Nov 15 05:43:37 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:43:37 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:43:37 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue"/>
Nov 15 05:43:37 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:43:37 user nova-compute[75648]:     </disk>
Nov 15 05:43:37 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:43:37 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:43:37 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk"/>
Nov 15 05:43:37 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:43:37 user nova-compute[75648]:     </disk>
Nov 15 05:43:37 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:43:37 user nova-compute[75648]:       <mac address="fa:16:3e:6a:e8:00"/>
Nov 15 05:43:37 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:37 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:43:37 user nova-compute[75648]:       <target dev="tap563c8454-c7"/>
Nov 15 05:43:37 user nova-compute[75648]:     </interface>
Nov 15 05:43:37 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:43:37 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/console.log" append="off"/>
Nov 15 05:43:37 user nova-compute[75648]:     </serial>
Nov 15 05:43:37 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:43:37 user nova-compute[75648]:     <video>
Nov 15 05:43:37 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:37 user nova-compute[75648]:     </video>
Nov 15 05:43:37 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:43:37 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:43:37 user nova-compute[75648]:     </rng>
Nov 15 05:43:37 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:43:37 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:43:37 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:43:37 user nova-compute[75648]:     </memballoon>
Nov 15 05:43:37 user nova-compute[75648]:   </devices>
Nov 15 05:43:37 user nova-compute[75648]: </domain>
Nov 15 05:43:37 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:43:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance destroyed successfully.
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:6a:e8:00, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:38 user nova-compute[75648]: WARNING nova.compute.manager [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:38 user nova-compute[75648]: WARNING nova.compute.manager [req-f262cd82-f765-4493-a498-a0f54a7fe473 req-8b5fbc1d-c003-46dc-9c85-ff5146b06a76 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:43:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance spawned successfully.
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:39 user nova-compute[75648]: INFO nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Took 9.17 seconds to spawn the instance on the hypervisor.
Nov 15 05:43:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:39 user nova-compute[75648]: INFO nova.compute.manager [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Took 10.28 seconds to build instance.
Nov 15 05:43:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b3e85817-81c5-4908-b353-9c40c3a94a30 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.391s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:40 user nova-compute[75648]: INFO nova.compute.manager [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Rescuing
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:40 user nova-compute[75648]: WARNING nova.compute.manager [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:40 user nova-compute[75648]: WARNING nova.compute.manager [req-a3d9f5ff-4024-40b8-9d45-8e10470cc7ad req-39d5424b-fa77-4c54-9a2f-85fda4c65380 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-e3b842e2-177f-4737-95a3-ed8a9668cfdc req-1d520ca6-99fe-458b-8757-5d4240b0c020 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e3b842e2-177f-4737-95a3-ed8a9668cfdc req-1d520ca6-99fe-458b-8757-5d4240b0c020 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e3b842e2-177f-4737-95a3-ed8a9668cfdc req-1d520ca6-99fe-458b-8757-5d4240b0c020 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e3b842e2-177f-4737-95a3-ed8a9668cfdc req-1d520ca6-99fe-458b-8757-5d4240b0c020 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-e3b842e2-177f-4737-95a3-ed8a9668cfdc req-1d520ca6-99fe-458b-8757-5d4240b0c020 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:41 user nova-compute[75648]: WARNING nova.compute.manager [req-e3b842e2-177f-4737-95a3-ed8a9668cfdc req-1d520ca6-99fe-458b-8757-5d4240b0c020 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state active and task_state None.
Nov 15 05:43:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a4bfedd6-e62c-4f0e-9b47-dfeafb774885 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-ff03028b-9dcc-4866-afff-baf8c393ce8b req-209efb1e-f7c1-4cd1-a977-3c17bbceff5c service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ff03028b-9dcc-4866-afff-baf8c393ce8b req-209efb1e-f7c1-4cd1-a977-3c17bbceff5c service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ff03028b-9dcc-4866-afff-baf8c393ce8b req-209efb1e-f7c1-4cd1-a977-3c17bbceff5c service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ff03028b-9dcc-4866-afff-baf8c393ce8b req-209efb1e-f7c1-4cd1-a977-3c17bbceff5c service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-ff03028b-9dcc-4866-afff-baf8c393ce8b req-209efb1e-f7c1-4cd1-a977-3c17bbceff5c service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:42 user nova-compute[75648]: WARNING nova.compute.manager [req-ff03028b-9dcc-4866-afff-baf8c393ce8b req-209efb1e-f7c1-4cd1-a977-3c17bbceff5c service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance destroyed successfully.
Nov 15 05:43:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Attempting a stable device rescue
Nov 15 05:43:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75648) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:43:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Creating image(s)
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "/opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG nova.objects.instance [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "f6af9e72bc55a7614397455fc5be4b8aa737307e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f6af9e72bc55a7614397455fc5be4b8aa737307e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-d27c6eae-085a-439b-a5f5-ead796f8622e req-8cad178c-b06c-4147-8223-6dd413633750 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d27c6eae-085a-439b-a5f5-ead796f8622e req-8cad178c-b06c-4147-8223-6dd413633750 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d27c6eae-085a-439b-a5f5-ead796f8622e req-8cad178c-b06c-4147-8223-6dd413633750 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d27c6eae-085a-439b-a5f5-ead796f8622e req-8cad178c-b06c-4147-8223-6dd413633750 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-d27c6eae-085a-439b-a5f5-ead796f8622e req-8cad178c-b06c-4147-8223-6dd413633750 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:44 user nova-compute[75648]: WARNING nova.compute.manager [req-d27c6eae-085a-439b-a5f5-ead796f8622e req-8cad178c-b06c-4147-8223-6dd413633750 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state active and task_state None.
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.part --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.virt.images [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] 34f31942-bfbd-4496-a5c9-d9e046f9cd04 was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.part /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-30f3a56c-ade6-49b6-8a0f-8163f584c54c req-54db6771-c4e4-44d3-99b0-80e7328243f3 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30f3a56c-ade6-49b6-8a0f-8163f584c54c req-54db6771-c4e4-44d3-99b0-80e7328243f3 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30f3a56c-ade6-49b6-8a0f-8163f584c54c req-54db6771-c4e4-44d3-99b0-80e7328243f3 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30f3a56c-ade6-49b6-8a0f-8163f584c54c req-54db6771-c4e4-44d3-99b0-80e7328243f3 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-30f3a56c-ade6-49b6-8a0f-8163f584c54c req-54db6771-c4e4-44d3-99b0-80e7328243f3 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:44 user nova-compute[75648]: WARNING nova.compute.manager [req-30f3a56c-ade6-49b6-8a0f-8163f584c54c req-54db6771-c4e4-44d3-99b0-80e7328243f3 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.part /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.converted" returned: 0 in 0.370s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:43:44 user nova-compute[75648]: INFO nova.compute.claims [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Claim successful on node user
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e.converted --force-share --output=json" returned: 0 in 0.231s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f6af9e72bc55a7614397455fc5be4b8aa737307e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.093s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "f6af9e72bc55a7614397455fc5be4b8aa737307e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f6af9e72bc55a7614397455fc5be4b8aa737307e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e --force-share --output=json" returned: 0 in 0.265s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e,backing_fmt=raw /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e,backing_fmt=raw /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue" returned: 0 in 0.058s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f6af9e72bc55a7614397455fc5be4b8aa737307e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'migration_context' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Start _get_guest_xml network_info=[{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "vif_mac": "fa:16:3e:81:0f:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '34f31942-bfbd-4496-a5c9-d9e046f9cd04', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'bcc39fb4-df67-4740-bd45-19cf3ce2ce2a', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3', 'attached_at': '', 'detached_at': '', 'volume_id': '986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'serial': '986f90c5-4d1a-44ec-979f-11b82dc0e3ff'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'resources' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'numa_topology' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:45 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:45 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:43:45 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:43:45 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:43:45 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-5250c9b4-47bf-4051-a667-58bdbe584a5d req-3f017247-2dcf-4238-8f23-f10876a00eb8 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5250c9b4-47bf-4051-a667-58bdbe584a5d req-3f017247-2dcf-4238-8f23-f10876a00eb8 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5250c9b4-47bf-4051-a667-58bdbe584a5d req-3f017247-2dcf-4238-8f23-f10876a00eb8 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5250c9b4-47bf-4051-a667-58bdbe584a5d req-3f017247-2dcf-4238-8f23-f10876a00eb8 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-5250c9b4-47bf-4051-a667-58bdbe584a5d req-3f017247-2dcf-4238-8f23-f10876a00eb8 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:45 user nova-compute[75648]: WARNING nova.compute.manager [req-5250c9b4-47bf-4051-a667-58bdbe584a5d req-3f017247-2dcf-4238-8f23-f10876a00eb8 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state rescued and task_state None.
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3066f4ba-28b8-4551-a38a-6a28a980e875]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = hLtjXNQK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 05:43:45 user nova-compute[75648]: node.name = iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:43:45 user nova-compute[75648]: node.tpgt = -1
Nov 15 05:43:45 user nova-compute[75648]: node.startup = automatic
Nov 15 05:43:45 user nova-compute[75648]: node.leading_login = No
Nov 15 05:43:45 user nova-compute[75648]: iface.iscsi_ifacename = default
Nov 15 05:43:45 user nova-compute[75648]: iface.net_ifacename = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.ipaddress = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.prefix_len = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.hwaddress = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.transport_name = tcp
Nov 15 05:43:45 user nova-compute[75648]: iface.initiatorname = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.vlan_id = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.vlan_priority = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.vlan_state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.iface_num = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.mtu = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.port = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.bootproto = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.subnet_mask = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.gateway = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_alt_client_id = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_dns = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_learn_iqn = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_vendor_id_state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_vendor_id = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.dhcp_slp_da = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.fragmentation = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.gratuitous_arp = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.incoming_forwarding = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.tos_state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.tos = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.ttl = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.delayed_ack = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.tcp_nagle = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.tcp_wsf_state = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.tcp_wsf = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.tcp_timer_scale = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.tcp_timestamp = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.redirect = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.def_task_mgmt_timeout = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.header_digest = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.data_digest = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.immediate_data = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.initial_r2t = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.data_seq_inorder = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.data_pdu_inorder = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.erl = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.max_receive_data_len = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.first_burst_len = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.max_outstanding_r2t = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.max_burst_len = 0
Nov 15 05:43:45 user nova-compute[75648]: iface.chap_auth = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.bidi_chap = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.strict_login_compliance = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.discovery_auth = <empty>
Nov 15 05:43:45 user nova-compute[75648]: iface.discovery_logout = <empty>
Nov 15 05:43:45 user nova-compute[75648]: node.discovery_address = <empty>
Nov 15 05:43:45 user nova-compute[75648]: node.discovery_port = 0
Nov 15 05:43:45 user nova-compute[75648]: node.discovery_type = static
Nov 15 05:43:45 user nova-compute[75648]: node.session.initial_cmdsn = 0
Nov 15 05:43:45 user nova-compute[75648]: node.session.initial_login_retry_max = 8
Nov 15 05:43:45 user nova-compute[75648]: node.session.xmit_thread_priority = -20
Nov 15 05:43:45 user nova-compute[75648]: node.session.cmds_max = 128
Nov 15 05:43:45 user nova-compute[75648]: node.session.queue_depth = 32
Nov 15 05:43:45 user nova-compute[75648]: node.session.nr_sessions = 1
Nov 15 05:43:45 user nova-compute[75648]: node.session.auth.authmethod = CHAP
Nov 15 05:43:45 user nova-compute[75648]: node.session.auth.username = hLtjXNQK
Nov 15 05:43:45 user nova-compute[75648]: node.session.auth.password = ***
Nov 15 05:43:45 user nova-compute[75648]: node.session.auth.username_in = <empty>
Nov 15 05:43:45 user nova-compute[75648]: node.session.auth.password_in = <empty>
Nov 15 05:43:45 user nova-compute[75648]: node.session.auth.chap_algs = MD5
Nov 15 05:43:45 user nova-compute[75648]: node.session.timeo.replacement_timeout = 120
Nov 15 05:43:45 user nova-compute[75648]: node.session.err_timeo.abort_timeout = 15
Nov 15 05:43:45 user nova-compute[75648]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 05:43:45 user nova-compute[75648]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 05:43:45 user nova-compute[75648]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.FastAbort = Yes
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.InitialR2T = No
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.ImmediateData = Yes
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.MaxConnections = 1
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 05:43:45 user nova-compute[75648]: node.session.iscsi.ERL = 0
Nov 15 05:43:45 user nova-compute[75648]: node.session.scan = manual
Nov 15 05:43:45 user nova-compute[75648]: node.session.reopen_max = 0
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].address = 172.16.0.220
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].port = 3260
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].startup = manual
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].tcp.window_size = 524288
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].tcp.type_of_service = 0
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].timeo.logout_timeout = 15
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].timeo.login_timeout = 15
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].timeo.auth_timeout = 45
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].iscsi.DataDigest = None
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].iscsi.IFMarker = No
Nov 15 05:43:45 user nova-compute[75648]: node.conn[0].iscsi.OFMarker = No
Nov 15 05:43:45 user nova-compute[75648]: # END RECORD
Nov 15 05:43:45 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdb6640-dd14-4ad9-8979-6e4f3a1e952f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69846f-326b-473b-bd5a-7c63fc1f7916]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLtjXNQK {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLtjXNQK" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4569bad6-24f9-4053-8b59-1ca3c5bd14aa]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLtjXNQK'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda43ab-1b50-4853-baee-d4a293f1cb62]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f44e963-603b-4b90-a223-7d138f0ee947]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:43:45 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:45 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:43:45 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.204s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] HCTL ('33', '0', '0', 0) found on session 14 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63f5f67-d7db-45f2-8c35-196bb3f432b3]: (4, ('0 0 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching for a device in session 14 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.246s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== connect_volume: return (248ms) {'type': 'block', 'scsi_wwn': '23661663565333732', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661663565333732', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-725986689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-725986689',id=14,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:42:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-xqtcs61e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:42:07Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "vif_mac": "fa:16:3e:81:0f:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "vif_mac": "fa:16:3e:81:0f:aa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:43:45 user nova-compute[75648]:   <uuid>3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3</uuid>
Nov 15 05:43:45 user nova-compute[75648]:   <name>instance-0000000e</name>
Nov 15 05:43:45 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:43:45 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:43:45 user nova-compute[75648]:   <metadata>
Nov 15 05:43:45 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:43:45 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:43:45 user nova-compute[75648]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-725986689</nova:name>
Nov 15 05:43:45 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:43:45</nova:creationTime>
Nov 15 05:43:45 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:43:45 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:43:45 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:43:45 user nova-compute[75648]:       <nova:owner>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:user uuid="47b4817a59584433a28790c3a16d0b5c">tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member</nova:user>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:project uuid="c13f9a55b45f4f9992e2f86628b34982">tempest-ServerBootFromVolumeStableRescueTest-893883912</nova:project>
Nov 15 05:43:45 user nova-compute[75648]:       </nova:owner>
Nov 15 05:43:45 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:43:45 user nova-compute[75648]:       <nova:ports>
Nov 15 05:43:45 user nova-compute[75648]:         <nova:port uuid="6472c753-29dc-40b6-be7a-761e5596244a">
Nov 15 05:43:45 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 05:43:45 user nova-compute[75648]:         </nova:port>
Nov 15 05:43:45 user nova-compute[75648]:       </nova:ports>
Nov 15 05:43:45 user nova-compute[75648]:     </nova:instance>
Nov 15 05:43:45 user nova-compute[75648]:   </metadata>
Nov 15 05:43:45 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:43:45 user nova-compute[75648]:     <system>
Nov 15 05:43:45 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:43:45 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:43:45 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:43:45 user nova-compute[75648]:       <entry name="serial">3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3</entry>
Nov 15 05:43:45 user nova-compute[75648]:       <entry name="uuid">3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3</entry>
Nov 15 05:43:45 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:43:45 user nova-compute[75648]:     </system>
Nov 15 05:43:45 user nova-compute[75648]:   </sysinfo>
Nov 15 05:43:45 user nova-compute[75648]:   <os>
Nov 15 05:43:45 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:43:45 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:43:45 user nova-compute[75648]:   </os>
Nov 15 05:43:45 user nova-compute[75648]:   <features>
Nov 15 05:43:45 user nova-compute[75648]:     <acpi/>
Nov 15 05:43:45 user nova-compute[75648]:     <apic/>
Nov 15 05:43:45 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:43:45 user nova-compute[75648]:   </features>
Nov 15 05:43:45 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:43:45 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:43:45 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:43:45 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:43:45 user nova-compute[75648]:   </clock>
Nov 15 05:43:45 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:43:45 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:43:45 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:43:45 user nova-compute[75648]:   </cpu>
Nov 15 05:43:45 user nova-compute[75648]:   <devices>
Nov 15 05:43:45 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:43:45 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:43:45 user nova-compute[75648]:       <source dev="/dev/sdb"/>
Nov 15 05:43:45 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:43:45 user nova-compute[75648]:       <serial>986f90c5-4d1a-44ec-979f-11b82dc0e3ff</serial>
Nov 15 05:43:45 user nova-compute[75648]:     </disk>
Nov 15 05:43:45 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:43:45 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:43:45 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue"/>
Nov 15 05:43:45 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:43:45 user nova-compute[75648]:       <boot order="1"/>
Nov 15 05:43:45 user nova-compute[75648]:     </disk>
Nov 15 05:43:45 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:43:45 user nova-compute[75648]:       <mac address="fa:16:3e:81:0f:aa"/>
Nov 15 05:43:45 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:45 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:43:45 user nova-compute[75648]:       <target dev="tap6472c753-29"/>
Nov 15 05:43:45 user nova-compute[75648]:     </interface>
Nov 15 05:43:45 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:43:45 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/console.log" append="off"/>
Nov 15 05:43:45 user nova-compute[75648]:     </serial>
Nov 15 05:43:45 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:43:45 user nova-compute[75648]:     <video>
Nov 15 05:43:45 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:45 user nova-compute[75648]:     </video>
Nov 15 05:43:45 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:43:45 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:43:45 user nova-compute[75648]:     </rng>
Nov 15 05:43:45 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:43:45 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:43:45 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:43:45 user nova-compute[75648]:     </memballoon>
Nov 15 05:43:45 user nova-compute[75648]:   </devices>
Nov 15 05:43:45 user nova-compute[75648]: </domain>
Nov 15 05:43:45 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:43:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:43:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance destroyed successfully.
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.policy [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '233bc61e55934b57bf40084001640bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c0c4fdf674d108496b63cd67ac2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No VIF found with MAC fa:16:3e:81:0f:aa, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:43:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Creating image(s)
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "/opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "/opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.205s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk 1073741824" returned: 0 in 0.061s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Successfully created port: a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.240s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Cannot resize image /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Ensure instance console log exists: /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-8a665800-7769-4377-b531-e58374856ff7 req-8a1e0392-c2d7-4a04-92e1-9d8056be1658 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8a665800-7769-4377-b531-e58374856ff7 req-8a1e0392-c2d7-4a04-92e1-9d8056be1658 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8a665800-7769-4377-b531-e58374856ff7 req-8a1e0392-c2d7-4a04-92e1-9d8056be1658 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8a665800-7769-4377-b531-e58374856ff7 req-8a1e0392-c2d7-4a04-92e1-9d8056be1658 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-8a665800-7769-4377-b531-e58374856ff7 req-8a1e0392-c2d7-4a04-92e1-9d8056be1658 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:47 user nova-compute[75648]: WARNING nova.compute.manager [req-8a665800-7769-4377-b531-e58374856ff7 req-8a1e0392-c2d7-4a04-92e1-9d8056be1658 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state rescued and task_state None.
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Successfully updated port: a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "refresh_cache-ea504b50-f1d5-4241-b01b-67beb3d15879" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquired lock "refresh_cache-ea504b50-f1d5-4241-b01b-67beb3d15879" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-changed-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Refreshing instance network info cache due to event network-changed-a978183e-0aa7-4637-9017-dae4f9d46de4. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] Acquiring lock "refresh_cache-ea504b50-f1d5-4241-b01b-67beb3d15879" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-7fd6d415-d76d-4071-ad2a-4750083c7f1e req-46d9ec1f-30ac-4f11-a22c-f60035343769 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7fd6d415-d76d-4071-ad2a-4750083c7f1e req-46d9ec1f-30ac-4f11-a22c-f60035343769 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7fd6d415-d76d-4071-ad2a-4750083c7f1e req-46d9ec1f-30ac-4f11-a22c-f60035343769 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7fd6d415-d76d-4071-ad2a-4750083c7f1e req-46d9ec1f-30ac-4f11-a22c-f60035343769 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-7fd6d415-d76d-4071-ad2a-4750083c7f1e req-46d9ec1f-30ac-4f11-a22c-f60035343769 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:47 user nova-compute[75648]: WARNING nova.compute.manager [req-7fd6d415-d76d-4071-ad2a-4750083c7f1e req-46d9ec1f-30ac-4f11-a22c-f60035343769 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Updating instance_info_cache with network_info: [{"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Releasing lock "refresh_cache-ea504b50-f1d5-4241-b01b-67beb3d15879" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Instance network_info: |[{"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] Acquired lock "refresh_cache-ea504b50-f1d5-4241-b01b-67beb3d15879" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.neutron [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Refreshing network info cache for port a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Start _get_guest_xml network_info=[{"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:43:48 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:48 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1723119768',display_name='tempest-VolumesActionsTest-instance-1723119768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1723119768',id=20,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80c0c4fdf674d108496b63cd67ac2af',ramdisk_id='',reservation_id='r-j860kb6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1279806277',owner_user_name='tempest-VolumesActionsTest-1279806277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:46Z,user_data=None,user_id='233bc61e55934b57bf40084001640bb3',uuid=ea504b50-f1d5-4241-b01b-67beb3d15879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converting VIF {"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lazy-loading 'pci_devices' on Instance uuid ea504b50-f1d5-4241-b01b-67beb3d15879 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:43:48 user nova-compute[75648]:   <uuid>ea504b50-f1d5-4241-b01b-67beb3d15879</uuid>
Nov 15 05:43:48 user nova-compute[75648]:   <name>instance-00000014</name>
Nov 15 05:43:48 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:43:48 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:43:48 user nova-compute[75648]:   <metadata>
Nov 15 05:43:48 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:43:48 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:43:48 user nova-compute[75648]:       <nova:name>tempest-VolumesActionsTest-instance-1723119768</nova:name>
Nov 15 05:43:48 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:43:48</nova:creationTime>
Nov 15 05:43:48 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:43:48 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:43:48 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:43:48 user nova-compute[75648]:       <nova:owner>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:user uuid="233bc61e55934b57bf40084001640bb3">tempest-VolumesActionsTest-1279806277-project-member</nova:user>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:project uuid="d80c0c4fdf674d108496b63cd67ac2af">tempest-VolumesActionsTest-1279806277</nova:project>
Nov 15 05:43:48 user nova-compute[75648]:       </nova:owner>
Nov 15 05:43:48 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:43:48 user nova-compute[75648]:       <nova:ports>
Nov 15 05:43:48 user nova-compute[75648]:         <nova:port uuid="a978183e-0aa7-4637-9017-dae4f9d46de4">
Nov 15 05:43:48 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 05:43:48 user nova-compute[75648]:         </nova:port>
Nov 15 05:43:48 user nova-compute[75648]:       </nova:ports>
Nov 15 05:43:48 user nova-compute[75648]:     </nova:instance>
Nov 15 05:43:48 user nova-compute[75648]:   </metadata>
Nov 15 05:43:48 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:43:48 user nova-compute[75648]:     <system>
Nov 15 05:43:48 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:43:48 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:43:48 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:43:48 user nova-compute[75648]:       <entry name="serial">ea504b50-f1d5-4241-b01b-67beb3d15879</entry>
Nov 15 05:43:48 user nova-compute[75648]:       <entry name="uuid">ea504b50-f1d5-4241-b01b-67beb3d15879</entry>
Nov 15 05:43:48 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:43:48 user nova-compute[75648]:     </system>
Nov 15 05:43:48 user nova-compute[75648]:   </sysinfo>
Nov 15 05:43:48 user nova-compute[75648]:   <os>
Nov 15 05:43:48 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:43:48 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:43:48 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:43:48 user nova-compute[75648]:   </os>
Nov 15 05:43:48 user nova-compute[75648]:   <features>
Nov 15 05:43:48 user nova-compute[75648]:     <acpi/>
Nov 15 05:43:48 user nova-compute[75648]:     <apic/>
Nov 15 05:43:48 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:43:48 user nova-compute[75648]:   </features>
Nov 15 05:43:48 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:43:48 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:43:48 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:43:48 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:43:48 user nova-compute[75648]:   </clock>
Nov 15 05:43:48 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:43:48 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:43:48 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:43:48 user nova-compute[75648]:   </cpu>
Nov 15 05:43:48 user nova-compute[75648]:   <devices>
Nov 15 05:43:48 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:43:48 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:43:48 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk"/>
Nov 15 05:43:48 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:43:48 user nova-compute[75648]:     </disk>
Nov 15 05:43:48 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:43:48 user nova-compute[75648]:       <mac address="fa:16:3e:4f:64:58"/>
Nov 15 05:43:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:48 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:43:48 user nova-compute[75648]:       <target dev="tapa978183e-0a"/>
Nov 15 05:43:48 user nova-compute[75648]:     </interface>
Nov 15 05:43:48 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:43:48 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/console.log" append="off"/>
Nov 15 05:43:48 user nova-compute[75648]:     </serial>
Nov 15 05:43:48 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:43:48 user nova-compute[75648]:     <video>
Nov 15 05:43:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:43:48 user nova-compute[75648]:     </video>
Nov 15 05:43:48 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:43:48 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:43:48 user nova-compute[75648]:     </rng>
Nov 15 05:43:48 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:43:48 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:43:48 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:43:48 user nova-compute[75648]:     </memballoon>
Nov 15 05:43:48 user nova-compute[75648]:   </devices>
Nov 15 05:43:48 user nova-compute[75648]: </domain>
Nov 15 05:43:48 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1723119768',display_name='tempest-VolumesActionsTest-instance-1723119768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1723119768',id=20,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80c0c4fdf674d108496b63cd67ac2af',ramdisk_id='',reservation_id='r-j860kb6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1279806277',owner_user_name='tempest-VolumesActionsTest-1279806277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:46Z,user_data=None,user_id='233bc61e55934b57bf40084001640bb3',uuid=ea504b50-f1d5-4241-b01b-67beb3d15879,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converting VIF {"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG os_vif [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96a42343-1035-5571-960b-0157ceeef3e6', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa978183e-0a, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa978183e-0a, col_values=(('qos', UUID('83249606-2192-4fc1-ad14-6006bed6139d')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa978183e-0a, col_values=(('external_ids', {'iface-id': 'a978183e-0aa7-4637-9017-dae4f9d46de4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:64:58', 'vm-uuid': 'ea504b50-f1d5-4241-b01b-67beb3d15879'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:48 user nova-compute[75648]: INFO os_vif [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a')
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] No VIF found with MAC fa:16:3e:4f:64:58, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.neutron [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Updated VIF entry in instance network info cache for port a978183e-0aa7-4637-9017-dae4f9d46de4. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG nova.network.neutron [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Updating instance_info_cache with network_info: [{"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cda50092-f106-4ddc-b53e-cc509665d789 req-c5c41bee-66e3-42cf-b0d2-1417a730ecc1 service nova] Releasing lock "refresh_cache-ea504b50-f1d5-4241-b01b-67beb3d15879" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-9397cfbc-3865-4236-8de6-28e8faef78cf req-2531bbef-5f4c-430b-9f8f-292c47e44735 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9397cfbc-3865-4236-8de6-28e8faef78cf req-2531bbef-5f4c-430b-9f8f-292c47e44735 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9397cfbc-3865-4236-8de6-28e8faef78cf req-2531bbef-5f4c-430b-9f8f-292c47e44735 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9397cfbc-3865-4236-8de6-28e8faef78cf req-2531bbef-5f4c-430b-9f8f-292c47e44735 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-9397cfbc-3865-4236-8de6-28e8faef78cf req-2531bbef-5f4c-430b-9f8f-292c47e44735 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:49 user nova-compute[75648]: WARNING nova.compute.manager [req-9397cfbc-3865-4236-8de6-28e8faef78cf req-2531bbef-5f4c-430b-9f8f-292c47e44735 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state active and task_state rescuing.
Nov 15 05:43:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-850f83b8-98de-4643-a12c-6e906d1f0bd7 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] No waiting events found dispatching network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:51 user nova-compute[75648]: WARNING nova.compute.manager [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received unexpected event network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 for instance with vm_state building and task_state spawning.
Nov 15 05:43:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] No waiting events found dispatching network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:51 user nova-compute[75648]: WARNING nova.compute.manager [req-29f7385c-efbe-4805-9403-01454a660670 req-28110cfc-bf7e-4fb4-859c-2593ca23c1ce service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received unexpected event network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 for instance with vm_state building and task_state spawning.
Nov 15 05:43:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:43:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Instance spawned successfully.
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:53 user nova-compute[75648]: INFO nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Took 7.30 seconds to spawn the instance on the hypervisor.
Nov 15 05:43:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:53 user nova-compute[75648]: INFO nova.compute.manager [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Took 8.61 seconds to build instance.
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d68c6788-5448-4c3a-89e8-56af8780a709 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.895s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue --force-share --output=json" returned: 0 in 0.268s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-changed-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Refreshing instance network info cache due to event network-changed-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] Acquiring lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] Acquired lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Refreshing network info cache for port 6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.459s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updated VIF entry in instance network info cache for port 6cc6ade0-cf5d-4caf-b7f8-5df427c874ce. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updating instance_info_cache with network_info: [{"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-84b1a4bb-ee60-4017-92d8-a7f4a3b699c4 req-76c0ea69-52a7-44c8-9588-a4dd884d8737 service nova] Releasing lock "refresh_cache-c0d5e58b-f341-43bc-bfd4-e59eec2c1064" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:43:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.285s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:57 user nova-compute[75648]: INFO nova.compute.manager [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Rebuilding instance
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-d2c56710-2b2a-4d62-9e36-dd15ab1451af req-16d7ae41-19a1-4950-bb25-ce56cee7e5d2 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-unplugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d2c56710-2b2a-4d62-9e36-dd15ab1451af req-16d7ae41-19a1-4950-bb25-ce56cee7e5d2 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d2c56710-2b2a-4d62-9e36-dd15ab1451af req-16d7ae41-19a1-4950-bb25-ce56cee7e5d2 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d2c56710-2b2a-4d62-9e36-dd15ab1451af req-16d7ae41-19a1-4950-bb25-ce56cee7e5d2 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-d2c56710-2b2a-4d62-9e36-dd15ab1451af req-16d7ae41-19a1-4950-bb25-ce56cee7e5d2 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-unplugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:43:58 user nova-compute[75648]: WARNING nova.compute.manager [req-d2c56710-2b2a-4d62-9e36-dd15ab1451af req-16d7ae41-19a1-4950-bb25-ce56cee7e5d2 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-unplugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state active and task_state rebuilding.
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance destroyed successfully.
Nov 15 05:43:58 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance destroyed successfully.
Nov 15 05:43:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1989909698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-660236792',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4TXXCUK1Zw5Q+zcG+nWn0/MlQIY8M6XgKF3HFBzzdeY6r8jDU/9lHGfjHL9z8KJ02ixkcmhgFHolLoWTeOShPOEMMUDtp7GwANshhAI/PTC2qnoHaRFZXIqjm/arwhkw==',key_name='tempest-keypair-2070814856',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4e0dd038b71424fb24a32f15c6b0abd',ramdisk_id='',reservation_id='r-a81ik3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1489834400',owner_user_name='tempest-ServerActionsV293TestJSON-1489834400-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfedcfe15ef443a5a72181d36da14635',uuid=c0d5e58b-f341-43bc-bfd4-e59eec2c1064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converting VIF {"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cc6ade0-cf, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cfdf41d4-49c7-435d-8882-c534dd46f010) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:43:58 user nova-compute[75648]: INFO os_vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf')
Nov 15 05:43:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:43:58 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d24b37-8d2a-45e1-8827-f4c66bee3f48]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:43:58 user nova-compute[75648]: No targets found.
Nov 15 05:43:58 user nova-compute[75648]: iSNS:
Nov 15 05:43:58 user nova-compute[75648]: No targets found.
Nov 15 05:43:58 user nova-compute[75648]: STATIC:
Nov 15 05:43:58 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:43:58 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:43:58 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:43:58 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d
Nov 15 05:43:58 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:43:58 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:43:58 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:43:58 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:43:58 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:43:58 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:43:58 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:43:58 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:43:58 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:43:58 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:43:58 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:43:58 user nova-compute[75648]: FIRMWARE:
Nov 15 05:43:58 user nova-compute[75648]: No targets found.
Nov 15 05:43:58 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:43:58 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:43:58 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb99345-f1ed-492d-9ec1-b0dba6ab8002]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9299af21-cc05-48d0-b2b0-23f0edabff10]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:43:58 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:43:58 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:43:58 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ae680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6179ac8f-df94-4c54-966e-22dc97364bad]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c76dc44-16ae-418b-8eaf-1d969eba3e7f]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[553b4978-1da6-4aac-8ca2-8ea23c6eb3e4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.080s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a8bf6-6712-433b-b420-71e71627879c]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2ad79d-36bb-4492-aba8-e5aac25da8f2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.133s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b2348b-0829-4c0d-8d86-06bb9abf8d11]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]
Nov 15 05:43:59 user nova-compute[75648]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.
Nov 15 05:43:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.074s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec65ee7-5391-45e0-959d-6159372fa54d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.649s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== disconnect_volume: return (652ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:43:59 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Deleting instance files /opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064_del
Nov 15 05:43:59 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Deletion of /opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064_del complete
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json" returned: 0 in 0.364s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:43:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance c0d5e58b-f341-43bc-bfd4-e59eec2c1064 could not be found.
Nov 15 05:44:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:00 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9299b6a9-4617-4aa2-86d9-c8768aa953ff]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:44:00 user nova-compute[75648]: No targets found.
Nov 15 05:44:00 user nova-compute[75648]: iSNS:
Nov 15 05:44:00 user nova-compute[75648]: No targets found.
Nov 15 05:44:00 user nova-compute[75648]: STATIC:
Nov 15 05:44:00 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:44:00 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:00 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:00 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d
Nov 15 05:44:00 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:00 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:00 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:44:00 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:00 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:00 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:44:00 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:00 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:00 user nova-compute[75648]: FIRMWARE:
Nov 15 05:44:00 user nova-compute[75648]: No targets found.
Nov 15 05:44:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:44:00 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:44:00 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[012ebc86-46c1-4b5c-bfe2-c3e6acffacc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac09659b-c513-4277-8ac2-7d4aa4b0395d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:00 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:00 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:00 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:00 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:00 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:00 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47f4ca0>, {}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Disconnecting from: [] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.109s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== disconnect_volume: return (112ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-b6f26ddb-4681-4574-8a43-3c5c82536359 req-b7dbd464-4a84-4f88-b670-72f0052a7ac9 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b6f26ddb-4681-4574-8a43-3c5c82536359 req-b7dbd464-4a84-4f88-b670-72f0052a7ac9 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b6f26ddb-4681-4574-8a43-3c5c82536359 req-b7dbd464-4a84-4f88-b670-72f0052a7ac9 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b6f26ddb-4681-4574-8a43-3c5c82536359 req-b7dbd464-4a84-4f88-b670-72f0052a7ac9 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-b6f26ddb-4681-4574-8a43-3c5c82536359 req-b7dbd464-4a84-4f88-b670-72f0052a7ac9 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:00 user nova-compute[75648]: WARNING nova.compute.manager [req-b6f26ddb-4681-4574-8a43-3c5c82536359 req-b7dbd464-4a84-4f88-b670-72f0052a7ac9 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state active and task_state rebuilding.
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Error from libvirt while getting description of instance-0000000f: [Error Code 42] Domain not found: no domain with matching uuid 'c0d5e58b-f341-43bc-bfd4-e59eec2c1064' (instance-0000000f): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c0d5e58b-f341-43bc-bfd4-e59eec2c1064' (instance-0000000f)
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:44:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:44:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7075MB free_disk=25.069103240966797GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Preparing to wait for external event volume-reimaged-64316407-b9e7-40e7-aa40-16b428a45059 {{(pid=75648) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c0d5e58b-f341-43bc-bfd4-e59eec2c1064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cd824673-df28-499e-8fa7-008d97468407 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 4d78e23e-b1d9-4395-9885-c515e558f673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 40448f79-0cbc-462a-be88-050f97128a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance ea504b50-f1d5-4241-b01b-67beb3d15879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:44:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:44:02 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:02 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:44:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.900s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "cd824673-df28-499e-8fa7-008d97468407" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "cd824673-df28-499e-8fa7-008d97468407-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "cd824673-df28-499e-8fa7-008d97468407-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:03 user nova-compute[75648]: INFO nova.compute.manager [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Terminating instance
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-858e43c8-8505-4e4a-9984-be224a68d0de req-d90fedc9-6fa0-4f5a-b533-7308ddfc3cf6 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-vif-unplugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-858e43c8-8505-4e4a-9984-be224a68d0de req-d90fedc9-6fa0-4f5a-b533-7308ddfc3cf6 service nova] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-858e43c8-8505-4e4a-9984-be224a68d0de req-d90fedc9-6fa0-4f5a-b533-7308ddfc3cf6 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-858e43c8-8505-4e4a-9984-be224a68d0de req-d90fedc9-6fa0-4f5a-b533-7308ddfc3cf6 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-858e43c8-8505-4e4a-9984-be224a68d0de req-d90fedc9-6fa0-4f5a-b533-7308ddfc3cf6 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] No waiting events found dispatching network-vif-unplugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-858e43c8-8505-4e4a-9984-be224a68d0de req-d90fedc9-6fa0-4f5a-b533-7308ddfc3cf6 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-vif-unplugged-9214936c-68b0-4726-891b-8e2598a21498 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:44:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cd824673-df28-499e-8fa7-008d97468407] Instance destroyed successfully.
Nov 15 05:44:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'resources' on Instance uuid cd824673-df28-499e-8fa7-008d97468407 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-656190521',display_name='tempest-VolumesAdminNegativeTest-server-656190521',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-656190521',id=16,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109b77e151fd4fdbb160739d831a08e1',ramdisk_id='',reservation_id='r-8qh2a3lc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1862472137',owner_user_name='tempest-VolumesAdminNegativeTest-1862472137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:42:15Z,user_data=None,user_id='cfefd577d6e44a2599e03538f036dd18',uuid=cd824673-df28-499e-8fa7-008d97468407,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converting VIF {"id": "9214936c-68b0-4726-891b-8e2598a21498", "address": "fa:16:3e:c7:e3:30", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9214936c-68", "ovs_interfaceid": "9214936c-68b0-4726-891b-8e2598a21498", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG os_vif [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9214936c-68, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b586bde6-6a36-4a31-8eae-fce1a6b42075) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:04 user nova-compute[75648]: INFO os_vif [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:e3:30,bridge_name='br-int',has_traffic_filtering=True,id=9214936c-68b0-4726-891b-8e2598a21498,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9214936c-68')
Nov 15 05:44:04 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Deleting instance files /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407_del
Nov 15 05:44:04 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Deletion of /opt/stack/data/nova/instances/cd824673-df28-499e-8fa7-008d97468407_del complete
Nov 15 05:44:04 user nova-compute[75648]: INFO nova.compute.manager [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: cd824673-df28-499e-8fa7-008d97468407] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 15 05:44:04 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: cd824673-df28-499e-8fa7-008d97468407] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: cd824673-df28-499e-8fa7-008d97468407] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:44:04 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: cd824673-df28-499e-8fa7-008d97468407] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:04 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: cd824673-df28-499e-8fa7-008d97468407] Took 0.70 seconds to deallocate network for instance.
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] Acquiring lock "cd824673-df28-499e-8fa7-008d97468407-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] Lock "cd824673-df28-499e-8fa7-008d97468407-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] No waiting events found dispatching network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:05 user nova-compute[75648]: WARNING nova.compute.manager [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received unexpected event network-vif-plugged-9214936c-68b0-4726-891b-8e2598a21498 for instance with vm_state deleted and task_state None.
Nov 15 05:44:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-9fc9330e-88e1-41dd-bef3-83eb694d40fd req-04e8756d-b29b-4de5-98d7-d8a5341e0b46 service nova] [instance: cd824673-df28-499e-8fa7-008d97468407] Received event network-vif-deleted-9214936c-68b0-4726-891b-8e2598a21498 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.591s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:05 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Deleted allocations for instance cd824673-df28-499e-8fa7-008d97468407
Nov 15 05:44:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0bc3e9e7-7789-4d70-8ef1-5b8841a39350 tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "cd824673-df28-499e-8fa7-008d97468407" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.945s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Acquiring lock "dd2caf40-987f-4dfa-a9a0-d75be63e641b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Lock "dd2caf40-987f-4dfa-a9a0-d75be63e641b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:44:07 user nova-compute[75648]: INFO nova.compute.claims [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Claim successful on node user
Nov 15 05:44:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:44:07 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:44:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:44:07 user nova-compute[75648]: INFO nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Booting with volume 433ed0c9-383d-43e9-be44-072c5791f09a at /dev/vda
Nov 15 05:44:08 user nova-compute[75648]: DEBUG nova.policy [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dfeba86e17f54ec39a87ef2df909d9b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36a531457d554ecf92dca25b6e0a135b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG os_brick.utils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d712b1-e822-44ea-8027-6df881d23a36]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea38fc61-bc52-437b-9a61-7349eff64bb1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3501bd7-9012-4976-a96c-d635b9e6cc7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88822548-9267-49b3-a8aa-ecfb7ede84c3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:08 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:44:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2d0dc9-3d36-4279-b363-f5bf759456fe]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG os_brick.utils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating existing volume attachment record: 2fd92f86-3b9b-4db5-b8cd-bb072abb6b9e {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:44:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully created port: 798db87f-dbc4-4b50-b710-5b4bf12bc3ac {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:44:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully created port: 42aa987a-1d92-4d8a-a643-c62dd6faaa81 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully created port: 5902b8c4-ffd4-4488-af19-ad1bbee38e63 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:10 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:44:10 user nova-compute[75648]: INFO nova.compute.claims [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Claim successful on node user
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully created port: 958c6031-6605-4860-a3d9-e73ae6ac1f25 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.network.neutron [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:44:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:44:11 user nova-compute[75648]: DEBUG nova.policy [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '000c6d537a8a4dbc9d7286083c5f6580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc975af351c474b82b020077f390c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:44:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Creating image(s)
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully created port: bd1ac58d-7479-4130-848a-ec8a1c894ed5 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.212s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk 1073741824" returned: 0 in 0.061s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Successfully created port: e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: 798db87f-dbc4-4b50-b710-5b4bf12bc3ac {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-798db87f-dbc4-4b50-b710-5b4bf12bc3ac {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-798db87f-dbc4-4b50-b710-5b4bf12bc3ac. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.network.neutron [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port 798db87f-dbc4-4b50-b710-5b4bf12bc3ac {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:12 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Cannot resize image /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Ensure instance console log exists: /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-265e3149-050d-4dca-b4a5-63d3b0a3a642 req-cc3d2fde-44c9-4efc-9e0b-0ba6e7bcb966 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Successfully updated port: e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquired lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-changed-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Refreshing instance network info cache due to event network-changed-e5dc1ff4-df0c-4836-83e5-95b381eef061. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] Acquiring lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Releasing lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Instance network_info: |[{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] Acquired lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Refreshing network info cache for port e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Start _get_guest_xml network_info=[{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:44:13 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:44:13 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:44:13 user nova-compute[75648]:   <uuid>3a095299-f948-48b7-aa05-ca494e9e5ec2</uuid>
Nov 15 05:44:13 user nova-compute[75648]:   <name>instance-00000016</name>
Nov 15 05:44:13 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:44:13 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:44:13 user nova-compute[75648]:   <metadata>
Nov 15 05:44:13 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:44:13 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:44:13 user nova-compute[75648]:       <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:44:13 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:44:13</nova:creationTime>
Nov 15 05:44:13 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:44:13 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:44:13 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:44:13 user nova-compute[75648]:       <nova:owner>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:44:13 user nova-compute[75648]:       </nova:owner>
Nov 15 05:44:13 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:44:13 user nova-compute[75648]:       <nova:ports>
Nov 15 05:44:13 user nova-compute[75648]:         <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:44:13 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:44:13 user nova-compute[75648]:         </nova:port>
Nov 15 05:44:13 user nova-compute[75648]:       </nova:ports>
Nov 15 05:44:13 user nova-compute[75648]:     </nova:instance>
Nov 15 05:44:13 user nova-compute[75648]:   </metadata>
Nov 15 05:44:13 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:44:13 user nova-compute[75648]:     <system>
Nov 15 05:44:13 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:44:13 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:44:13 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:44:13 user nova-compute[75648]:       <entry name="serial">3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:44:13 user nova-compute[75648]:       <entry name="uuid">3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:44:13 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:44:13 user nova-compute[75648]:     </system>
Nov 15 05:44:13 user nova-compute[75648]:   </sysinfo>
Nov 15 05:44:13 user nova-compute[75648]:   <os>
Nov 15 05:44:13 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:44:13 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:44:13 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:44:13 user nova-compute[75648]:   </os>
Nov 15 05:44:13 user nova-compute[75648]:   <features>
Nov 15 05:44:13 user nova-compute[75648]:     <acpi/>
Nov 15 05:44:13 user nova-compute[75648]:     <apic/>
Nov 15 05:44:13 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:44:13 user nova-compute[75648]:   </features>
Nov 15 05:44:13 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:44:13 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:44:13 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:44:13 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:44:13 user nova-compute[75648]:   </clock>
Nov 15 05:44:13 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:44:13 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:44:13 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:44:13 user nova-compute[75648]:   </cpu>
Nov 15 05:44:13 user nova-compute[75648]:   <devices>
Nov 15 05:44:13 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:44:13 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:44:13 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk"/>
Nov 15 05:44:13 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:44:13 user nova-compute[75648]:     </disk>
Nov 15 05:44:13 user nova-compute[75648]:     <disk type="file" device="cdrom">
Nov 15 05:44:13 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none"/>
Nov 15 05:44:13 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config"/>
Nov 15 05:44:13 user nova-compute[75648]:       <target dev="hda" bus="ide"/>
Nov 15 05:44:13 user nova-compute[75648]:     </disk>
Nov 15 05:44:13 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:44:13 user nova-compute[75648]:       <mac address="fa:16:3e:dd:95:c0"/>
Nov 15 05:44:13 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:44:13 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:44:13 user nova-compute[75648]:       <target dev="tape5dc1ff4-df"/>
Nov 15 05:44:13 user nova-compute[75648]:     </interface>
Nov 15 05:44:13 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:44:13 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log" append="off"/>
Nov 15 05:44:13 user nova-compute[75648]:     </serial>
Nov 15 05:44:13 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:44:13 user nova-compute[75648]:     <video>
Nov 15 05:44:13 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:44:13 user nova-compute[75648]:     </video>
Nov 15 05:44:13 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:44:13 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:44:13 user nova-compute[75648]:     </rng>
Nov 15 05:44:13 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:44:13 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:44:13 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:44:13 user nova-compute[75648]:     </memballoon>
Nov 15 05:44:13 user nova-compute[75648]:   </devices>
Nov 15 05:44:13 user nova-compute[75648]: </domain>
Nov 15 05:44:13 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG os_vif [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a20a429-9856-5136-a508-09be6f701411', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:44:14 user nova-compute[75648]: INFO nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Booting with volume a74e1d9e-39f2-4714-92e6-147fcdc36021 at /dev/vdb
Nov 15 05:44:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5dc1ff4-df, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5dc1ff4-df, col_values=(('qos', UUID('1d583e0c-dc91-4c60-b2dd-9016aec02c5a')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5dc1ff4-df, col_values=(('external_ids', {'iface-id': 'e5dc1ff4-df0c-4836-83e5-95b381eef061', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:95:c0', 'vm-uuid': '3a095299-f948-48b7-aa05-ca494e9e5ec2'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:14 user nova-compute[75648]: INFO os_vif [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df')
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: 6606551e-9dd1-4aa6-a7fc-562f295fd986 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG os_brick.utils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No BDM found with device name hda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No VIF found with MAC fa:16:3e:dd:95:c0, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:44:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Using config drive
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9e2a1e-7fac-43f5-9cfd-3db8f96bde08]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf1e367-781c-463e-848f-899feae819c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7144cc45-888a-4c04-9147-cb3a20511726]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[447a8132-1948-4d99-8339-ad9c84649df5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:14 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af28b29-6709-4ce6-afff-50c83de0112d]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG os_brick.utils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating existing volume attachment record: e14e08bc-92c2-4b24-8bcf-63002f5316f6 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:44:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Creating config drive at /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3lab_k_1 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.network.neutron [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updated VIF entry in instance network info cache for port e5dc1ff4-df0c-4836-83e5-95b381eef061. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.network.neutron [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1eb6fa69-945f-47ad-9f54-71094c02101d req-b3241429-1918-4caa-a025-fefef785c2ec service nova] Releasing lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp3lab_k_1" returned: 0 in 0.135s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: fe89c6dd-da29-457a-9765-fff8dd6c9ace {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-6606551e-9dd1-4aa6-a7fc-562f295fd986 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-6606551e-9dd1-4aa6-a7fc-562f295fd986. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port 6606551e-9dd1-4aa6-a7fc-562f295fd986 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-fe89c6dd-da29-457a-9765-fff8dd6c9ace {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-fe89c6dd-da29-457a-9765-fff8dd6c9ace. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port fe89c6dd-da29-457a-9765-fff8dd6c9ace {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: 42aa987a-1d92-4d8a-a643-c62dd6faaa81 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ded956a2-4b7d-4afa-a18c-5b07ec4620ea req-25684b0d-69fa-4c30-8492-a32dd3992ae1 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-74aeef1b-4426-4e00-9625-fa2d7428102d req-bc1cba5f-a3bb-4013-8ccf-92c716428557 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-plugged-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-74aeef1b-4426-4e00-9625-fa2d7428102d req-bc1cba5f-a3bb-4013-8ccf-92c716428557 service nova] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-74aeef1b-4426-4e00-9625-fa2d7428102d req-bc1cba5f-a3bb-4013-8ccf-92c716428557 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-74aeef1b-4426-4e00-9625-fa2d7428102d req-bc1cba5f-a3bb-4013-8ccf-92c716428557 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-74aeef1b-4426-4e00-9625-fa2d7428102d req-bc1cba5f-a3bb-4013-8ccf-92c716428557 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] No waiting events found dispatching network-vif-plugged-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:16 user nova-compute[75648]: WARNING nova.compute.manager [req-74aeef1b-4426-4e00-9625-fa2d7428102d req-bc1cba5f-a3bb-4013-8ccf-92c716428557 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received unexpected event network-vif-plugged-e5dc1ff4-df0c-4836-83e5-95b381eef061 for instance with vm_state building and task_state spawning.
Nov 15 05:44:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: 5902b8c4-ffd4-4488-af19-ad1bbee38e63 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: 958c6031-6605-4860-a3d9-e73ae6ac1f25 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-42aa987a-1d92-4d8a-a643-c62dd6faaa81 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-42aa987a-1d92-4d8a-a643-c62dd6faaa81. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port 42aa987a-1d92-4d8a-a643-c62dd6faaa81 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-5902b8c4-ffd4-4488-af19-ad1bbee38e63 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-5902b8c4-ffd4-4488-af19-ad1bbee38e63. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port 5902b8c4-ffd4-4488-af19-ad1bbee38e63 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Successfully updated port: bd1ac58d-7479-4130-848a-ec8a1c894ed5 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-958c6031-6605-4860-a3d9-e73ae6ac1f25 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-958c6031-6605-4860-a3d9-e73ae6ac1f25. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port 958c6031-6605-4860-a3d9-e73ae6ac1f25 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-3d9dd4dc-b493-4952-846f-e498443c7d7c req-38a01f36-ea1a-4e93-9c43-38af9e8a0f38 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-plugged-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3d9dd4dc-b493-4952-846f-e498443c7d7c req-38a01f36-ea1a-4e93-9c43-38af9e8a0f38 service nova] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3d9dd4dc-b493-4952-846f-e498443c7d7c req-38a01f36-ea1a-4e93-9c43-38af9e8a0f38 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3d9dd4dc-b493-4952-846f-e498443c7d7c req-38a01f36-ea1a-4e93-9c43-38af9e8a0f38 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-3d9dd4dc-b493-4952-846f-e498443c7d7c req-38a01f36-ea1a-4e93-9c43-38af9e8a0f38 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] No waiting events found dispatching network-vif-plugged-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:18 user nova-compute[75648]: WARNING nova.compute.manager [req-3d9dd4dc-b493-4952-846f-e498443c7d7c req-38a01f36-ea1a-4e93-9c43-38af9e8a0f38 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received unexpected event network-vif-plugged-e5dc1ff4-df0c-4836-83e5-95b381eef061 for instance with vm_state building and task_state spawning.
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5899e3d1-4880-457a-973e-7fd321fee9ce req-a3a75d23-6e02-4c46-93df-3b08ae89c0c6 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:44:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Instance spawned successfully.
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:44:18 user nova-compute[75648]: INFO nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 15 05:44:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:44:18 user nova-compute[75648]: INFO nova.compute.manager [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Took 8.07 seconds to build instance.
Nov 15 05:44:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-27d5fab1-04e6-4d37-a716-f8143f62ca71 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.185s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.volume.cinder [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Update attachment failed for attachment e14e08bc-92c2-4b24-8bcf-63002f5316f6. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Traceback (most recent call last):
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     driver_block_device.attach_block_devices(
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     _log_and_attach(device)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     bdm.attach(*attach_args, **attach_kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     ret_val = method(obj, context, *args, **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     self._do_attach(context, instance, volume, volume_api,
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     self._volume_attach(context, volume, connector, instance,
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     connection_info = volume_api.attachment_update(
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     res = method(self, ctx, *args, **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     with excutils.save_and_reraise_exception():
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     self.force_reraise()
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     raise self.value
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     context, '3.44', skip_version_check=True).attachments.update(
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     return method.func(obj, *args, **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     resp = self._update('/attachments/%s' % id, body)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     return self._cs_request(url, 'PUT', **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     return self.request(url, method, **kwargs)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b]     raise exceptions.from_response(resp, body)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7)
Nov 15 05:44:19 user nova-compute[75648]: ERROR nova.compute.manager [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] 
Nov 15 05:44:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Received event network-changed-bd1ac58d-7479-4130-848a-ec8a1c894ed5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing instance network info cache due to event network-changed-bd1ac58d-7479-4130-848a-ec8a1c894ed5. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] Acquiring lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-b40ec7b2-9648-49b1-8833-9b4a438e192c req-78aad29e-6a42-4050-bbe7-cff443f3bd60 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event volume-reimaged-64316407-b9e7-40e7-aa40-16b428a45059 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b40ec7b2-9648-49b1-8833-9b4a438e192c req-78aad29e-6a42-4050-bbe7-cff443f3bd60 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b40ec7b2-9648-49b1-8833-9b4a438e192c req-78aad29e-6a42-4050-bbe7-cff443f3bd60 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b40ec7b2-9648-49b1-8833-9b4a438e192c req-78aad29e-6a42-4050-bbe7-cff443f3bd60 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-b40ec7b2-9648-49b1-8833-9b4a438e192c req-78aad29e-6a42-4050-bbe7-cff443f3bd60 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Processing event volume-reimaged-64316407-b9e7-40e7-aa40-16b428a45059 {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:44:19 user nova-compute[75648]: INFO nova.virt.block_device [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Booting with volume 64316407-b9e7-40e7-aa40-16b428a45059 at /dev/vda
Nov 15 05:44:19 user nova-compute[75648]: DEBUG os_brick.utils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7f8ad0-ae61-4d65-8a59-6430d1f3726a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f5c038e-e746-4835-97bc-cd2a0645f5b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0791893-dee6-4cd2-81e6-ac04bafcc54c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c730078e-9a0b-4c37-8fda-a67ddfd3a01f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:19 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:44:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa5f8c3-2a75-4c72-a51b-70604192eca1]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG os_brick.utils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:19 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updating existing volume attachment record: 8da00e63-9aae-4095-93d3-bc0fc03675e3 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [{"id": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "address": "fa:16:3e:0d:d8:ba", "network": {"id": "551e900d-ad03-45b1-99e5-bd67a3f183ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1807242888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798db87f-db", "ovs_interfaceid": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "address": "fa:16:3e:b8:e3:36", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6606551e-9d", "ovs_interfaceid": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "address": "fa:16:3e:cd:36:5d", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe89c6dd-da", "ovs_interfaceid": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "address": "fa:16:3e:48:26:c3", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42aa987a-1d", "ovs_interfaceid": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "address": "fa:16:3e:bf:fc:92", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5902b8c4-ff", "ovs_interfaceid": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "address": "fa:16:3e:6b:92:84", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958c6031-66", "ovs_interfaceid": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "address": "fa:16:3e:15:02:44", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd1ac58d-74", "ovs_interfaceid": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Instance network_info: |[{"id": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "address": "fa:16:3e:0d:d8:ba", "network": {"id": "551e900d-ad03-45b1-99e5-bd67a3f183ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1807242888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798db87f-db", "ovs_interfaceid": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "address": "fa:16:3e:b8:e3:36", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6606551e-9d", "ovs_interfaceid": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "address": "fa:16:3e:cd:36:5d", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe89c6dd-da", "ovs_interfaceid": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "address": "fa:16:3e:48:26:c3", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42aa987a-1d", "ovs_interfaceid": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "address": "fa:16:3e:bf:fc:92", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5902b8c4-ff", "ovs_interfaceid": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "address": "fa:16:3e:6b:92:84", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958c6031-66", "ovs_interfaceid": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "address": "fa:16:3e:15:02:44", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd1ac58d-74", "ovs_interfaceid": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] Acquired lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG nova.network.neutron [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Refreshing network info cache for port bd1ac58d-7479-4130-848a-ec8a1c894ed5 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG nova.compute.claims [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Aborting claim: <nova.compute.claims.Claim object at 0x7fe9f03d9c90> {{(pid=75648) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updated VIF entry in instance network info cache for port bd1ac58d-7479-4130-848a-ec8a1c894ed5. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [{"id": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "address": "fa:16:3e:0d:d8:ba", "network": {"id": "551e900d-ad03-45b1-99e5-bd67a3f183ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1807242888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798db87f-db", "ovs_interfaceid": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "address": "fa:16:3e:b8:e3:36", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6606551e-9d", "ovs_interfaceid": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "address": "fa:16:3e:cd:36:5d", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe89c6dd-da", "ovs_interfaceid": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "address": "fa:16:3e:48:26:c3", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42aa987a-1d", "ovs_interfaceid": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "address": "fa:16:3e:bf:fc:92", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5902b8c4-ff", "ovs_interfaceid": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "address": "fa:16:3e:6b:92:84", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958c6031-66", "ovs_interfaceid": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "address": "fa:16:3e:15:02:44", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd1ac58d-74", "ovs_interfaceid": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b1220672-3824-486f-a71b-d140c35ad037 req-795ab080-9930-442a-aa43-693b1fbd86f0 service nova] Releasing lock "refresh_cache-dd2caf40-987f-4dfa-a9a0-d75be63e641b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 1.006s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Build of instance dd2caf40-987f-4dfa-a9a0-d75be63e641b aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7) {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.compute.utils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Build of instance dd2caf40-987f-4dfa-a9a0-d75be63e641b aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75648) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 15 05:44:21 user nova-compute[75648]: ERROR nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Build of instance dd2caf40-987f-4dfa-a9a0-d75be63e641b aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7): nova.exception.BuildAbortException: Build of instance dd2caf40-987f-4dfa-a9a0-d75be63e641b aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3916ba2c-f426-4aad-acea-7c5b421c24e7)
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Unplugging VIFs for instance {{(pid=75648) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "address": "fa:16:3e:0d:d8:ba", "network": {"id": "551e900d-ad03-45b1-99e5-bd67a3f183ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1807242888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798db87f-db", "ovs_interfaceid": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "address": "fa:16:3e:0d:d8:ba", "network": {"id": "551e900d-ad03-45b1-99e5-bd67a3f183ca", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1807242888-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap798db87f-db", "ovs_interfaceid": "798db87f-dbc4-4b50-b710-5b4bf12bc3ac", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ba,bridge_name='br-int',has_traffic_filtering=True,id=798db87f-dbc4-4b50-b710-5b4bf12bc3ac,network=Network(551e900d-ad03-45b1-99e5-bd67a3f183ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798db87f-db') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ba,bridge_name='br-int',has_traffic_filtering=True,id=798db87f-dbc4-4b50-b710-5b4bf12bc3ac,network=Network(551e900d-ad03-45b1-99e5-bd67a3f183ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798db87f-db') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap798db87f-db, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:d8:ba,bridge_name='br-int',has_traffic_filtering=True,id=798db87f-dbc4-4b50-b710-5b4bf12bc3ac,network=Network(551e900d-ad03-45b1-99e5-bd67a3f183ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap798db87f-db')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "address": "fa:16:3e:b8:e3:36", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6606551e-9d", "ovs_interfaceid": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "address": "fa:16:3e:b8:e3:36", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6606551e-9d", "ovs_interfaceid": "6606551e-9dd1-4aa6-a7fc-562f295fd986", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:36,bridge_name='br-int',has_traffic_filtering=True,id=6606551e-9dd1-4aa6-a7fc-562f295fd986,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6606551e-9d') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:36,bridge_name='br-int',has_traffic_filtering=True,id=6606551e-9dd1-4aa6-a7fc-562f295fd986,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6606551e-9d') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6606551e-9d, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e3:36,bridge_name='br-int',has_traffic_filtering=True,id=6606551e-9dd1-4aa6-a7fc-562f295fd986,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6606551e-9d')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "address": "fa:16:3e:cd:36:5d", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe89c6dd-da", "ovs_interfaceid": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "address": "fa:16:3e:cd:36:5d", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.33", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe89c6dd-da", "ovs_interfaceid": "fe89c6dd-da29-457a-9765-fff8dd6c9ace", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:36:5d,bridge_name='br-int',has_traffic_filtering=True,id=fe89c6dd-da29-457a-9765-fff8dd6c9ace,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe89c6dd-da') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:36:5d,bridge_name='br-int',has_traffic_filtering=True,id=fe89c6dd-da29-457a-9765-fff8dd6c9ace,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe89c6dd-da') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe89c6dd-da, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:36:5d,bridge_name='br-int',has_traffic_filtering=True,id=fe89c6dd-da29-457a-9765-fff8dd6c9ace,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfe89c6dd-da')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "address": "fa:16:3e:48:26:c3", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42aa987a-1d", "ovs_interfaceid": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "address": "fa:16:3e:48:26:c3", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.47", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap42aa987a-1d", "ovs_interfaceid": "42aa987a-1d92-4d8a-a643-c62dd6faaa81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:26:c3,bridge_name='br-int',has_traffic_filtering=True,id=42aa987a-1d92-4d8a-a643-c62dd6faaa81,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42aa987a-1d') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:26:c3,bridge_name='br-int',has_traffic_filtering=True,id=42aa987a-1d92-4d8a-a643-c62dd6faaa81,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42aa987a-1d') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap42aa987a-1d, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:26:c3,bridge_name='br-int',has_traffic_filtering=True,id=42aa987a-1d92-4d8a-a643-c62dd6faaa81,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap42aa987a-1d')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "address": "fa:16:3e:bf:fc:92", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5902b8c4-ff", "ovs_interfaceid": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "address": "fa:16:3e:bf:fc:92", "network": {"id": "1a893039-3ace-4b90-9463-00390da66a49", "bridge": "br-int", "label": "tempest-device-tagging-net1-123977228", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.115", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5902b8c4-ff", "ovs_interfaceid": "5902b8c4-ffd4-4488-af19-ad1bbee38e63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=5902b8c4-ffd4-4488-af19-ad1bbee38e63,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5902b8c4-ff') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=5902b8c4-ffd4-4488-af19-ad1bbee38e63,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5902b8c4-ff') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5902b8c4-ff, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:fc:92,bridge_name='br-int',has_traffic_filtering=True,id=5902b8c4-ffd4-4488-af19-ad1bbee38e63,network=Network(1a893039-3ace-4b90-9463-00390da66a49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5902b8c4-ff')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "address": "fa:16:3e:6b:92:84", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958c6031-66", "ovs_interfaceid": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "address": "fa:16:3e:6b:92:84", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap958c6031-66", "ovs_interfaceid": "958c6031-6605-4860-a3d9-e73ae6ac1f25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:84,bridge_name='br-int',has_traffic_filtering=True,id=958c6031-6605-4860-a3d9-e73ae6ac1f25,network=Network(dd310357-f0eb-419e-a244-40416d1216c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958c6031-66') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:84,bridge_name='br-int',has_traffic_filtering=True,id=958c6031-6605-4860-a3d9-e73ae6ac1f25,network=Network(dd310357-f0eb-419e-a244-40416d1216c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958c6031-66') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap958c6031-66, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:92:84,bridge_name='br-int',has_traffic_filtering=True,id=958c6031-6605-4860-a3d9-e73ae6ac1f25,network=Network(dd310357-f0eb-419e-a244-40416d1216c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap958c6031-66')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-981173046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-981173046',id=21,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMHuLlg2sse71mGA5jNKKG8lEQtC7V8MX6SKt7lPiLF7ut00Xzh7gz7yqs0TmTprug2pJd9Jk7MV8OHwaBAtGOq6u0PtMZ2fqUC0yqLNXng9zhmOJIlClIJxcoBzOo1nAw==',key_name='tempest-keypair-593315316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36a531457d554ecf92dca25b6e0a135b',ramdisk_id='',reservation_id='r-30vf9hoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-31779314',owner_user_name='tempest-TaggedBootDevicesTest-31779314-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dfeba86e17f54ec39a87ef2df909d9b4',uuid=dd2caf40-987f-4dfa-a9a0-d75be63e641b,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "address": "fa:16:3e:15:02:44", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd1ac58d-74", "ovs_interfaceid": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converting VIF {"id": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "address": "fa:16:3e:15:02:44", "network": {"id": "dd310357-f0eb-419e-a244-40416d1216c1", "bridge": "br-int", "label": "tempest-device-tagging-net2-1535483280", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "36a531457d554ecf92dca25b6e0a135b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd1ac58d-74", "ovs_interfaceid": "bd1ac58d-7479-4130-848a-ec8a1c894ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:02:44,bridge_name='br-int',has_traffic_filtering=True,id=bd1ac58d-7479-4130-848a-ec8a1c894ed5,network=Network(dd310357-f0eb-419e-a244-40416d1216c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd1ac58d-74') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:02:44,bridge_name='br-int',has_traffic_filtering=True,id=bd1ac58d-7479-4130-848a-ec8a1c894ed5,network=Network(dd310357-f0eb-419e-a244-40416d1216c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd1ac58d-74') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd1ac58d-74, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:21 user nova-compute[75648]: INFO os_vif [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:02:44,bridge_name='br-int',has_traffic_filtering=True,id=bd1ac58d-7479-4130-848a-ec8a1c894ed5,network=Network(dd310357-f0eb-419e-a244-40416d1216c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd1ac58d-74')
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Unplugged VIFs for instance {{(pid=75648) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:44:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:44:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:44:24 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Creating image(s)
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Ensure instance console log exists: /opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Start _get_guest_xml network_info=[{"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '8da00e63-9aae-4095-93d3-bc0fc03675e3', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c0d5e58b-f341-43bc-bfd4-e59eec2c1064', 'attached_at': '', 'detached_at': '', 'volume_id': '64316407-b9e7-40e7-aa40-16b428a45059', 'serial': '64316407-b9e7-40e7-aa40-16b428a45059'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:44:24 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 05:44:24 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lazy-loading 'vcpu_model' on Instance uuid c0d5e58b-f341-43bc-bfd4-e59eec2c1064 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:24 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:44:24 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:44:24 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3567c5-11af-4d19-931c-d5daf9da4f3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:44:24 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea67ea5a-274f-4bc2-a6d1-074568830d6f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059] added
Nov 15 05:44:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6cfd20-226c-4921-a262-1fd8038c9822]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7768a54c-15bf-4aaf-a666-456cdf7f3e8f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mySbqVYC {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mySbqVYC" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0356f8-7685-4059-bb64-5ccee902f6c6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mySbqVYC'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8ed009-2daa-4d99-9ac8-265035343ff6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e46e97f-49e7-414f-ae6f-9db59aa912e9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e25024-9411-47a5-aad9-c428086cd0ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]
Nov 15 05:44:24 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.
Nov 15 05:44:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b24789e-d6fe-4db6-8ce3-65f3304f61fe]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: INFO nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Took 3.11 seconds to deallocate network for instance.
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c2fa51-8180-44ab-ac56-66bdeb9dc0b6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:24 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:24 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cbdf87-886f-4ed1-8d56-1ca8e106910b]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:44:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:44:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Detaching volume: 433ed0c9-383d-43e9-be44-072c5791f09a {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 15 05:44:25 user nova-compute[75648]: INFO nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Detaching volume 433ed0c9-383d-43e9-be44-072c5791f09a
Nov 15 05:44:25 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Skipping driver_detach during remote rebuild. {{(pid=75648) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 15 05:44:25 user nova-compute[75648]: WARNING nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Failed to detach volume: 433ed0c9-383d-43e9-be44-072c5791f09a due to 'NoneType' object has no attribute 'devices'
Nov 15 05:44:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Detaching volume: a74e1d9e-39f2-4714-92e6-147fcdc36021 {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 15 05:44:25 user nova-compute[75648]: INFO nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Detaching volume a74e1d9e-39f2-4714-92e6-147fcdc36021
Nov 15 05:44:25 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Skipping driver_detach during remote rebuild. {{(pid=75648) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 15 05:44:25 user nova-compute[75648]: WARNING nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Failed to detach volume: a74e1d9e-39f2-4714-92e6-147fcdc36021 due to 'NoneType' object has no attribute 'devices'
Nov 15 05:44:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Detaching volume: eb6235c5-370a-4486-a3de-10c419f65455 {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 15 05:44:25 user nova-compute[75648]: INFO nova.compute.manager [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Detaching volume eb6235c5-370a-4486-a3de-10c419f65455
Nov 15 05:44:25 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] [instance: dd2caf40-987f-4dfa-a9a0-d75be63e641b] Skipping driver_detach during remote rebuild. {{(pid=75648) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 15 05:44:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23562613632316134', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562613632316134', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1989909698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-660236792',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4TXXCUK1Zw5Q+zcG+nWn0/MlQIY8M6XgKF3HFBzzdeY6r8jDU/9lHGfjHL9z8KJ02ixkcmhgFHolLoWTeOShPOEMMUDtp7GwANshhAI/PTC2qnoHaRFZXIqjm/arwhkw==',key_name='tempest-keypair-2070814856',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4e0dd038b71424fb24a32f15c6b0abd',ramdisk_id='',reservation_id='r-a81ik3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1489834400',owner_user_name='tempest-ServerActionsV293TestJSON-1489834400-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfedcfe15ef443a5a72181d36da14635',uuid=c0d5e58b-f341-43bc-bfd4-e59eec2c1064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converting VIF {"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:44:26 user nova-compute[75648]:   <uuid>c0d5e58b-f341-43bc-bfd4-e59eec2c1064</uuid>
Nov 15 05:44:26 user nova-compute[75648]:   <name>instance-0000000f</name>
Nov 15 05:44:26 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:44:26 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:44:26 user nova-compute[75648]:   <metadata>
Nov 15 05:44:26 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:44:26 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:44:26 user nova-compute[75648]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1989909698</nova:name>
Nov 15 05:44:26 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:44:24</nova:creationTime>
Nov 15 05:44:26 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:44:26 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:44:26 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:44:26 user nova-compute[75648]:       <nova:owner>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:user uuid="bfedcfe15ef443a5a72181d36da14635">tempest-ServerActionsV293TestJSON-1489834400-project-member</nova:user>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:project uuid="e4e0dd038b71424fb24a32f15c6b0abd">tempest-ServerActionsV293TestJSON-1489834400</nova:project>
Nov 15 05:44:26 user nova-compute[75648]:       </nova:owner>
Nov 15 05:44:26 user nova-compute[75648]:       <nova:ports>
Nov 15 05:44:26 user nova-compute[75648]:         <nova:port uuid="6cc6ade0-cf5d-4caf-b7f8-5df427c874ce">
Nov 15 05:44:26 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:44:26 user nova-compute[75648]:         </nova:port>
Nov 15 05:44:26 user nova-compute[75648]:       </nova:ports>
Nov 15 05:44:26 user nova-compute[75648]:     </nova:instance>
Nov 15 05:44:26 user nova-compute[75648]:   </metadata>
Nov 15 05:44:26 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:44:26 user nova-compute[75648]:     <system>
Nov 15 05:44:26 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:44:26 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:44:26 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:44:26 user nova-compute[75648]:       <entry name="serial">c0d5e58b-f341-43bc-bfd4-e59eec2c1064</entry>
Nov 15 05:44:26 user nova-compute[75648]:       <entry name="uuid">c0d5e58b-f341-43bc-bfd4-e59eec2c1064</entry>
Nov 15 05:44:26 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:44:26 user nova-compute[75648]:     </system>
Nov 15 05:44:26 user nova-compute[75648]:   </sysinfo>
Nov 15 05:44:26 user nova-compute[75648]:   <os>
Nov 15 05:44:26 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:44:26 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:44:26 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:44:26 user nova-compute[75648]:   </os>
Nov 15 05:44:26 user nova-compute[75648]:   <features>
Nov 15 05:44:26 user nova-compute[75648]:     <acpi/>
Nov 15 05:44:26 user nova-compute[75648]:     <apic/>
Nov 15 05:44:26 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:44:26 user nova-compute[75648]:   </features>
Nov 15 05:44:26 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:44:26 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:44:26 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:44:26 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:44:26 user nova-compute[75648]:   </clock>
Nov 15 05:44:26 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:44:26 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:44:26 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:44:26 user nova-compute[75648]:   </cpu>
Nov 15 05:44:26 user nova-compute[75648]:   <devices>
Nov 15 05:44:26 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:44:26 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:44:26 user nova-compute[75648]:       <source dev="/dev/sdc"/>
Nov 15 05:44:26 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:44:26 user nova-compute[75648]:       <serial>64316407-b9e7-40e7-aa40-16b428a45059</serial>
Nov 15 05:44:26 user nova-compute[75648]:     </disk>
Nov 15 05:44:26 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:44:26 user nova-compute[75648]:       <mac address="fa:16:3e:4e:d6:00"/>
Nov 15 05:44:26 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:44:26 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:44:26 user nova-compute[75648]:       <target dev="tap6cc6ade0-cf"/>
Nov 15 05:44:26 user nova-compute[75648]:     </interface>
Nov 15 05:44:26 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:44:26 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064/console.log" append="off"/>
Nov 15 05:44:26 user nova-compute[75648]:     </serial>
Nov 15 05:44:26 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:44:26 user nova-compute[75648]:     <video>
Nov 15 05:44:26 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:44:26 user nova-compute[75648]:     </video>
Nov 15 05:44:26 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:44:26 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:44:26 user nova-compute[75648]:     </rng>
Nov 15 05:44:26 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:44:26 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:44:26 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:44:26 user nova-compute[75648]:     </memballoon>
Nov 15 05:44:26 user nova-compute[75648]:   </devices>
Nov 15 05:44:26 user nova-compute[75648]: </domain>
Nov 15 05:44:26 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1989909698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-660236792',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4TXXCUK1Zw5Q+zcG+nWn0/MlQIY8M6XgKF3HFBzzdeY6r8jDU/9lHGfjHL9z8KJ02ixkcmhgFHolLoWTeOShPOEMMUDtp7GwANshhAI/PTC2qnoHaRFZXIqjm/arwhkw==',key_name='tempest-keypair-2070814856',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e4e0dd038b71424fb24a32f15c6b0abd',ramdisk_id='',reservation_id='r-a81ik3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1489834400',owner_user_name='tempest-ServerActionsV293TestJSON-1489834400-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfedcfe15ef443a5a72181d36da14635',uuid=c0d5e58b-f341-43bc-bfd4-e59eec2c1064,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converting VIF {"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG os_vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '758923e0-093c-54c4-86cc-a09bcd0f461b', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6cc6ade0-cf, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6cc6ade0-cf, col_values=(('qos', UUID('e1d32729-aa67-42d2-93ca-d8bf151d289f')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6cc6ade0-cf, col_values=(('external_ids', {'iface-id': '6cc6ade0-cf5d-4caf-b7f8-5df427c874ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:d6:00', 'vm-uuid': 'c0d5e58b-f341-43bc-bfd4-e59eec2c1064'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:26 user nova-compute[75648]: INFO os_vif [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf')
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:44:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] No VIF found with MAC fa:16:3e:4e:d6:00, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:44:26 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Deleted allocations for instance dd2caf40-987f-4dfa-a9a0-d75be63e641b
Nov 15 05:44:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a10b8588-1eb8-4293-bb12-8243b30f9945 tempest-TaggedBootDevicesTest-31779314 tempest-TaggedBootDevicesTest-31779314-project-member] Lock "dd2caf40-987f-4dfa-a9a0-d75be63e641b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.260s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-593e378c-254a-4a44-8adb-22fd8c054774 req-4c61714e-b74b-4fa6-af1b-d94943668141 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-593e378c-254a-4a44-8adb-22fd8c054774 req-4c61714e-b74b-4fa6-af1b-d94943668141 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-593e378c-254a-4a44-8adb-22fd8c054774 req-4c61714e-b74b-4fa6-af1b-d94943668141 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-593e378c-254a-4a44-8adb-22fd8c054774 req-4c61714e-b74b-4fa6-af1b-d94943668141 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-593e378c-254a-4a44-8adb-22fd8c054774 req-4c61714e-b74b-4fa6-af1b-d94943668141 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:27 user nova-compute[75648]: WARNING nova.compute.manager [req-593e378c-254a-4a44-8adb-22fd8c054774 req-4c61714e-b74b-4fa6-af1b-d94943668141 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state active and task_state rebuild_spawning.
Nov 15 05:44:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:29 user nova-compute[75648]: INFO nova.compute.manager [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Detaching volume c0cd44d8-8f7f-4813-8c17-c1430067b14d
Nov 15 05:44:29 user nova-compute[75648]: INFO nova.virt.block_device [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Attempting to driver detach volume c0cd44d8-8f7f-4813-8c17-c1430067b14d from mountpoint /dev/vdc
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Attempting to detach device vdc from instance 4d78e23e-b1d9-4395-9885-c515e558f673 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:44:29 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:44:29 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:44:29 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 05:44:29 user nova-compute[75648]:   <serial>c0cd44d8-8f7f-4813-8c17-c1430067b14d</serial>
Nov 15 05:44:29 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 05:44:29 user nova-compute[75648]: </disk>
Nov 15 05:44:29 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:44:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully detached device vdc from instance 4d78e23e-b1d9-4395-9885-c515e558f673 from the persistent domain config.
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4d78e23e-b1d9-4395-9885-c515e558f673 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:44:29 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:44:29 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:44:29 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 05:44:29 user nova-compute[75648]:   <serial>c0cd44d8-8f7f-4813-8c17-c1430067b14d</serial>
Nov 15 05:44:29 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 05:44:29 user nova-compute[75648]: </disk>
Nov 15 05:44:29 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:44:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance spawned successfully.
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.008s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75648) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-b360af59-8b94-411d-bcdc-6aea8b18216c req-6ddf027f-5dc3-46e9-8333-d54e9ef04607 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b360af59-8b94-411d-bcdc-6aea8b18216c req-6ddf027f-5dc3-46e9-8333-d54e9ef04607 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b360af59-8b94-411d-bcdc-6aea8b18216c req-6ddf027f-5dc3-46e9-8333-d54e9ef04607 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b360af59-8b94-411d-bcdc-6aea8b18216c req-6ddf027f-5dc3-46e9-8333-d54e9ef04607 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-b360af59-8b94-411d-bcdc-6aea8b18216c req-6ddf027f-5dc3-46e9-8333-d54e9ef04607 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:29 user nova-compute[75648]: WARNING nova.compute.manager [req-b360af59-8b94-411d-bcdc-6aea8b18216c req-6ddf027f-5dc3-46e9-8333-d54e9ef04607 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state active and task_state None.
Nov 15 05:44:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:44:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40ec7b2-9648-49b1-8833-9b4a438e192c tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.091s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:38 user nova-compute[75648]: INFO nova.compute.manager [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Unrescuing
Nov 15 05:44:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:38 user nova-compute[75648]: DEBUG nova.network.neutron [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:44:38 user nova-compute[75648]: DEBUG nova.network.neutron [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'flavor' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG nova.compute.manager [req-91783403-c98a-49a5-ae31-4264a119bef8 req-0071875f-84ae-4db4-88fd-a6b9f3c901f3 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-91783403-c98a-49a5-ae31-4264a119bef8 req-0071875f-84ae-4db4-88fd-a6b9f3c901f3 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-91783403-c98a-49a5-ae31-4264a119bef8 req-0071875f-84ae-4db4-88fd-a6b9f3c901f3 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-91783403-c98a-49a5-ae31-4264a119bef8 req-0071875f-84ae-4db4-88fd-a6b9f3c901f3 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:39 user nova-compute[75648]: DEBUG nova.compute.manager [req-91783403-c98a-49a5-ae31-4264a119bef8 req-0071875f-84ae-4db4-88fd-a6b9f3c901f3 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:39 user nova-compute[75648]: WARNING nova.compute.manager [req-91783403-c98a-49a5-ae31-4264a119bef8 req-0071875f-84ae-4db4-88fd-a6b9f3c901f3 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:44:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance destroyed successfully.
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing instance network info cache due to event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updated VIF entry in instance network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing instance network info cache due to event network-changed-c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Acquiring lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Acquired lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Refreshing network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updated VIF entry in instance network info cache for port c780fe40-bbb3-4c6c-96c8-066f066fe06a. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [{"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Releasing lock "refresh_cache-fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:42 user nova-compute[75648]: WARNING nova.compute.manager [req-29d7abe7-31a7-498d-ac5e-cba213be5fea req-303187c9-1f9a-4db8-b39e-1220361d3d13 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:44:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.objects.instance [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'flavor' on Instance uuid c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:43 user nova-compute[75648]: INFO nova.compute.manager [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Attaching volume 9580cf81-50af-4882-ba41-c689d1ddf69d to /dev/vdb
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-06ce21db-c551-4d61-b39f-db3d71dc26c6 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:43 user nova-compute[75648]: WARNING nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:43 user nova-compute[75648]: WARNING nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-changed-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Refreshing instance network info cache due to event network-changed-c521ce3a-2c60-4c74-a3ce-ca8a2b194064. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Acquiring lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Acquired lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Refreshing network info cache for port c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG os_brick.utils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e067fc-d5cc-40ec-a3ba-448e92140127]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a6fe98-7d00-4628-bc86-1b5ff12dcda7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08c5be6-f67e-48ad-a3b1-49b41a9795ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[696fe0d0-0fe1-4bdc-8b19-5a604f028e4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:44:43 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:44:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af3d741-0875-44dd-97ca-84959aa6b93b]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG os_brick.utils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:43 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updating existing volume attachment record: cc739c15-c09a-45da-bb84-f72258426cfb {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:44:44 user nova-compute[75648]: DEBUG nova.network.neutron [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updated VIF entry in instance network info cache for port c521ce3a-2c60-4c74-a3ce-ca8a2b194064. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:44:44 user nova-compute[75648]: DEBUG nova.network.neutron [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updating instance_info_cache with network_info: [{"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09cbe3ce-275a-49e6-8ece-1315eec9be52 req-70034fb5-fcd6-4f30-9956-e18d52ffdae9 service nova] Releasing lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:44:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:46 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:48 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:48 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgfLcYKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:49 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:44:49 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:44:49 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f10c0da-e978-47fc-941d-f942998ed83c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:44:49 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c48cf5-61d3-43ad-bc06-e3876d933d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d] added
Nov 15 05:44:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e752925c-e008-450d-b48e-0642dca36d7c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[468ed444-0714-49ba-bd75-36f220070664]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgfLcYKM {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TgfLcYKM" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[91675ef7-4954-4343-ba0d-18839bdccf4a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TgfLcYKM'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9558cf-41fc-4981-84ec-fa80383689de]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc098b1e-d4c4-4af4-a15a-548001eed094]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[160ce7bd-4587-4ed9-82ba-67cb33a8a603]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260]
Nov 15 05:44:49 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260] successful.
Nov 15 05:44:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[869325f5-5390-464a-9b5b-30164876ab7f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c3279d-4be8-4e33-9318-44d080b2e5e1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)
Nov 15 05:44:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:49 user nova-compute[75648]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)
Nov 15 05:44:49 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d5a44e-2fbc-493b-8e89-942a95107f82]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgfLcYKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:44:49 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4d78e23e-b1d9-4395-9885-c515e558f673 is timed out.
Nov 15 05:44:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully detached device vdc from instance 4d78e23e-b1d9-4395-9885-c515e558f673 from the live domain config.
Nov 15 05:44:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZgLcPznr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:44:49 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:44:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26439633464663965', 'path': '/dev/sdg'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439633464663965', 'path': '/dev/sdg'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.737s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG nova.objects.instance [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'flavor' on Instance uuid c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83321d4d-0401-460d-8e12-ce8484608ecc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:44:50 user nova-compute[75648]: No targets found.
Nov 15 05:44:50 user nova-compute[75648]: iSNS:
Nov 15 05:44:50 user nova-compute[75648]: No targets found.
Nov 15 05:44:50 user nova-compute[75648]: STATIC:
Nov 15 05:44:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:44:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d
Nov 15 05:44:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:44:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:44:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d
Nov 15 05:44:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:44:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:44:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:44:50 user nova-compute[75648]: FIRMWARE:
Nov 15 05:44:50 user nova-compute[75648]: No targets found.
Nov 15 05:44:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:44:50 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:44:50 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:44:50 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:44:50 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:44:50 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:44:50 user nova-compute[75648]:   <serial>9580cf81-50af-4882-ba41-c689d1ddf69d</serial>
Nov 15 05:44:50 user nova-compute[75648]: </disk>
Nov 15 05:44:50 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[019ab9dd-ea10-4e14-b9ab-34360cac3150]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc2841b-8272-4093-b334-3bbf59f72da8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)
Nov 15 05:44:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:44:50 user nova-compute[75648]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)
Nov 15 05:44:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47dd090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfabbe91-461d-4c91-b111-8c80ca3ec593]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4c80f4-4d82-4b82-b138-a9a679738550]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9b2860-9201-420f-925e-4aff39d8c1d8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcedece4-4cc4-49a7-8f3d-35d12b2be335]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c759507-8aa2-4f56-beb7-90bc603e8acb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8add5e-f7b2-4447-9a11-cb7bf0318727]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260]
Nov 15 05:44:50 user nova-compute[75648]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d, portal: 172.16.0.220,3260] successful.
Nov 15 05:44:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0cd44d8-8f7f-4813-8c17-c1430067b14d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36e0b09-5c0b-4c9b-8676-a0d3277a7ff2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:44:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:44:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:44:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] <== disconnect_volume: return (1044ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:44:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] No VIF found with MAC fa:16:3e:7a:8b:2b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'flavor' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-bf8f45a6-3e9f-4fee-be49-3a5d842c5be4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.954s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-308475ce-64a4-4e95-8d6d-f77346290d3d tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.060s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:44:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:54 user nova-compute[75648]: INFO nova.compute.manager [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Detaching volume 9580cf81-50af-4882-ba41-c689d1ddf69d
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:54 user nova-compute[75648]: INFO nova.virt.block_device [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Attempting to driver detach volume 9580cf81-50af-4882-ba41-c689d1ddf69d from mountpoint /dev/vdb
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Attempting to detach device vdb from instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:44:54 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:44:54 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:44:54 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:44:54 user nova-compute[75648]:   <serial>9580cf81-50af-4882-ba41-c689d1ddf69d</serial>
Nov 15 05:44:54 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:44:54 user nova-compute[75648]: </disk>
Nov 15 05:44:54 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:44:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully detached device vdb from instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f from the persistent domain config.
Nov 15 05:44:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:44:54 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:44:54 user nova-compute[75648]:   <source dev="/dev/sdg"/>
Nov 15 05:44:54 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:44:54 user nova-compute[75648]:   <serial>9580cf81-50af-4882-ba41-c689d1ddf69d</serial>
Nov 15 05:44:54 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:44:54 user nova-compute[75648]: </disk>
Nov 15 05:44:54 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:56 user nova-compute[75648]: INFO nova.compute.manager [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Terminating instance
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-1b6f9a7a-a816-47fe-a6ba-66405ad3e65b req-32127b08-187e-4f2e-acc0-662e097e996d service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-vif-unplugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1b6f9a7a-a816-47fe-a6ba-66405ad3e65b req-32127b08-187e-4f2e-acc0-662e097e996d service nova] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1b6f9a7a-a816-47fe-a6ba-66405ad3e65b req-32127b08-187e-4f2e-acc0-662e097e996d service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1b6f9a7a-a816-47fe-a6ba-66405ad3e65b req-32127b08-187e-4f2e-acc0-662e097e996d service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-1b6f9a7a-a816-47fe-a6ba-66405ad3e65b req-32127b08-187e-4f2e-acc0-662e097e996d service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] No waiting events found dispatching network-vif-unplugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-1b6f9a7a-a816-47fe-a6ba-66405ad3e65b req-32127b08-187e-4f2e-acc0-662e097e996d service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-vif-unplugged-c584c83b-4c1f-47ad-bbda-60412268bef6 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Instance destroyed successfully.
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lazy-loading 'resources' on Instance uuid 177ad35a-a9fc-4c31-89d5-2592bb24bb4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1383988142',display_name='tempest-VolumesAdminNegativeTest-server-1383988142',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1383988142',id=8,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLTRlVQuigqJPU0AgGyZ+8/hVqmBtMdr6VfQBS5rKZY9x9JuSSZQoN6pbdeZvNejBqXeDaVEQJi4REHhTN9ffB8OBI7LHPJNB/n9kxxrzpKBMbMhmhLRm7lJBI1jIlrJw==',key_name='tempest-keypair-1818642414',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109b77e151fd4fdbb160739d831a08e1',ramdisk_id='',reservation_id='r-9vnp2q45',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1862472137',owner_user_name='tempest-VolumesAdminNegativeTest-1862472137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:39:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfefd577d6e44a2599e03538f036dd18',uuid=177ad35a-a9fc-4c31-89d5-2592bb24bb4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converting VIF {"id": "c584c83b-4c1f-47ad-bbda-60412268bef6", "address": "fa:16:3e:a1:6d:18", "network": {"id": "34e17c02-a3c2-4588-9736-14187692bda2", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1276526083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109b77e151fd4fdbb160739d831a08e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc584c83b-4c", "ovs_interfaceid": "c584c83b-4c1f-47ad-bbda-60412268bef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG os_vif [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc584c83b-4c, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5273f783-800c-462b-b919-7488bcb04c7e) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:56 user nova-compute[75648]: INFO os_vif [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a1:6d:18,bridge_name='br-int',has_traffic_filtering=True,id=c584c83b-4c1f-47ad-bbda-60412268bef6,network=Network(34e17c02-a3c2-4588-9736-14187692bda2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc584c83b-4c')
Nov 15 05:44:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Deleting instance files /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c_del
Nov 15 05:44:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Deletion of /opt/stack/data/nova/instances/177ad35a-a9fc-4c31-89d5-2592bb24bb4c_del complete
Nov 15 05:44:56 user nova-compute[75648]: INFO nova.compute.manager [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:44:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:44:57 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Took 0.96 seconds to deallocate network for instance.
Nov 15 05:44:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-263c8d36-3c43-48bd-84fd-68104cef6cda req-1f3c5d0e-0b35-42f8-8987-5608355c7444 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-vif-deleted-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-b3d78d12-eb74-4295-b37f-45ced647b25c req-4c536bdf-a37c-4140-afb9-958012cd4a42 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received event network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b3d78d12-eb74-4295-b37f-45ced647b25c req-4c536bdf-a37c-4140-afb9-958012cd4a42 service nova] Acquiring lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b3d78d12-eb74-4295-b37f-45ced647b25c req-4c536bdf-a37c-4140-afb9-958012cd4a42 service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b3d78d12-eb74-4295-b37f-45ced647b25c req-4c536bdf-a37c-4140-afb9-958012cd4a42 service nova] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-b3d78d12-eb74-4295-b37f-45ced647b25c req-4c536bdf-a37c-4140-afb9-958012cd4a42 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] No waiting events found dispatching network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:44:58 user nova-compute[75648]: WARNING nova.compute.manager [req-b3d78d12-eb74-4295-b37f-45ced647b25c req-4c536bdf-a37c-4140-afb9-958012cd4a42 service nova] [instance: 177ad35a-a9fc-4c31-89d5-2592bb24bb4c] Received unexpected event network-vif-plugged-c584c83b-4c1f-47ad-bbda-60412268bef6 for instance with vm_state deleted and task_state None.
Nov 15 05:44:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:44:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=6680MB free_disk=24.98937225341797GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:44:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.047s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.407s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:44:59 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Deleted allocations for instance 177ad35a-a9fc-4c31-89d5-2592bb24bb4c
Nov 15 05:44:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c7144541-9fe6-40f0-bbe5-fe123edb661c tempest-VolumesAdminNegativeTest-1862472137 tempest-VolumesAdminNegativeTest-1862472137-project-member] Lock "177ad35a-a9fc-4c31-89d5-2592bb24bb4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.213s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c0d5e58b-f341-43bc-bfd4-e59eec2c1064 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 4d78e23e-b1d9-4395-9885-c515e558f673 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 40448f79-0cbc-462a-be88-050f97128a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance ea504b50-f1d5-4241-b01b-67beb3d15879 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 05:44:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 05:45:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:45:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:45:01 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating instance_info_cache with network_info: [{"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:01 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:45:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:11 user nova-compute[75648]: INFO nova.compute.manager [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Detaching volume dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:45:11 user nova-compute[75648]: INFO nova.virt.block_device [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Attempting to driver detach volume dc9a592b-3819-402e-ac1c-cca273cc1626 from mountpoint /dev/vdb
Nov 15 05:45:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Attempting to detach device vdb from instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:45:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:45:11 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:45:11 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:45:11 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:45:11 user nova-compute[75648]:   <serial>dc9a592b-3819-402e-ac1c-cca273cc1626</serial>
Nov 15 05:45:11 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:45:11 user nova-compute[75648]: </disk>
Nov 15 05:45:11 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:45:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Successfully detached device vdb from instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c from the persistent domain config.
Nov 15 05:45:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:45:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:45:11 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:45:11 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:45:11 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:45:11 user nova-compute[75648]:   <serial>dc9a592b-3819-402e-ac1c-cca273cc1626</serial>
Nov 15 05:45:11 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:45:11 user nova-compute[75648]: </disk>
Nov 15 05:45:11 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:45:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:45:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-changed-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Refreshing instance network info cache due to event network-changed-a6126e35-cf95-47e8-8898-48be16256eb2. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] Acquiring lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] Acquired lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:12 user nova-compute[75648]: DEBUG nova.network.neutron [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Refreshing network info cache for port a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:45:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updated VIF entry in instance network info cache for port a6126e35-cf95-47e8-8898-48be16256eb2. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:45:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updating instance_info_cache with network_info: [{"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d934df2-7555-4695-a941-74dec8b22aab req-77e24fe0-0d1a-491f-be04-f2846bdf48d9 service nova] Releasing lock "refresh_cache-d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:15 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f is timed out.
Nov 15 05:45:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully detached device vdb from instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f from the live domain config.
Nov 15 05:45:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TgfLcYKM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:15 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d122f79-f6a8-44b0-8b5f-01e84b755b4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:45:15 user nova-compute[75648]: No targets found.
Nov 15 05:45:15 user nova-compute[75648]: iSNS:
Nov 15 05:45:15 user nova-compute[75648]: No targets found.
Nov 15 05:45:15 user nova-compute[75648]: STATIC:
Nov 15 05:45:15 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:45:15 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:15 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:15 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:45:15 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:15 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:15 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:45:15 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:15 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:15 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d
Nov 15 05:45:15 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:15 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:15 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:45:15 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:15 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:15 user nova-compute[75648]: FIRMWARE:
Nov 15 05:45:15 user nova-compute[75648]: No targets found.
Nov 15 05:45:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:45:15 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:45:15 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[513ff6e3-9573-4dcc-bee9-cf0322b6ce49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[912ce6e4-b49f-4bc9-b279-afd5af6cac5b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)
Nov 15 05:45:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:15 user nova-compute[75648]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d (non-flash)
Nov 15 05:45:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9f93f7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d'): ({'sdg'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Removing single pathed devices sdg {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89ee5fb-b5fe-4701-b55e-d23bd881f0c7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18702eab-22a8-4e3a-ae21-93cc057abfe4]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Flushing IO for device /dev/sdg {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc53d6-3bda-4711-b2f9-7613b56a25cd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6820692-1879-4acb-af40-104cff66c459]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2c3175-0ddb-4c5d-9320-d871d13f2d2b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[774dc54b-0e38-4a13-8964-d3ebaa0bedd0]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260]
Nov 15 05:45:15 user nova-compute[75648]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9580cf81-50af-4882-ba41-c689d1ddf69d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[be40aea3-1e98-4b9d-a305-871462011d27]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] <== disconnect_volume: return (363ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:45:16 user nova-compute[75648]: DEBUG nova.objects.instance [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'flavor' on Instance uuid c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-edc85a1b-bebf-4ca3-b3b3-f7b0d75987e6 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.927s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:45:19 user nova-compute[75648]: INFO nova.compute.claims [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Claim successful on node user
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:45:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.network.neutron [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:19 user nova-compute[75648]: INFO nova.compute.manager [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Terminating instance
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:45:19 user nova-compute[75648]: INFO nova.virt.block_device [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Booting with volume snapshot 24fe695e-fd24-45f1-a87c-8cf2e8be3327 at /dev/vda
Nov 15 05:45:19 user nova-compute[75648]: DEBUG nova.policy [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd4a8513df14fc7ab09905d24220ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea832b577b9445782f27e28b1023e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-e990917c-879c-45f8-8011-5c13e9cfb19c req-24348c8d-72a9-4383-bf64-e2f178931bd9 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-unplugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e990917c-879c-45f8-8011-5c13e9cfb19c req-24348c8d-72a9-4383-bf64-e2f178931bd9 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e990917c-879c-45f8-8011-5c13e9cfb19c req-24348c8d-72a9-4383-bf64-e2f178931bd9 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e990917c-879c-45f8-8011-5c13e9cfb19c req-24348c8d-72a9-4383-bf64-e2f178931bd9 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-e990917c-879c-45f8-8011-5c13e9cfb19c req-24348c8d-72a9-4383-bf64-e2f178931bd9 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-unplugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-e990917c-879c-45f8-8011-5c13e9cfb19c req-24348c8d-72a9-4383-bf64-e2f178931bd9 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-unplugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:45:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Instance destroyed successfully.
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'resources' on Instance uuid 4d78e23e-b1d9-4395-9885-c515e558f673 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:38:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-66321000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-66321000',id=4,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDT+QGtGruou8hlWAeV8P8X62pba6X7eOjVaz/tvu5u3SCbGg/SxnXOtKGrikVZrRneh/S1kvQSGR2M/f/nHBiMy9u1xauxL+Y3J+AuoDGdIUtVKPP72cn9HYYFfyNF3cQ==',key_name='tempest-keypair-2114855632',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-0dc600ua',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:43:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=4d78e23e-b1d9-4395-9885-c515e558f673,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "address": "fa:16:3e:ad:9b:17", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf91e5406-2b", "ovs_interfaceid": "f91e5406-2b2a-45e8-86a4-81edc6a8a06f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG os_vif [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf91e5406-2b, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e02e919c-04f4-4c0b-ab35-599e60241f26) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:20 user nova-compute[75648]: INFO os_vif [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:9b:17,bridge_name='br-int',has_traffic_filtering=True,id=f91e5406-2b2a-45e8-86a4-81edc6a8a06f,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf91e5406-2b')
Nov 15 05:45:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Deleting instance files /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673_del
Nov 15 05:45:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Deletion of /opt/stack/data/nova/instances/4d78e23e-b1d9-4395-9885-c515e558f673_del complete
Nov 15 05:45:20 user nova-compute[75648]: INFO nova.compute.manager [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 15 05:45:20 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:45:20 user nova-compute[75648]: DEBUG nova.network.neutron [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Successfully created port: f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:45:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:21 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:21 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Took 0.71 seconds to deallocate network for instance.
Nov 15 05:45:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:21 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:21 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Deleted allocations for instance 4d78e23e-b1d9-4395-9885-c515e558f673
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d33c2e81-bddb-4bc9-be51-cb384278d390 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "4d78e23e-b1d9-4395-9885-c515e558f673" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.306s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Successfully updated port: f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquired lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-changed-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Refreshing instance network info cache due to event network-changed-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] Acquiring lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] Acquiring lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] Lock "4d78e23e-b1d9-4395-9885-c515e558f673-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] No waiting events found dispatching network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:22 user nova-compute[75648]: WARNING nova.compute.manager [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received unexpected event network-vif-plugged-f91e5406-2b2a-45e8-86a4-81edc6a8a06f for instance with vm_state deleted and task_state None.
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-df4894bc-7504-4612-a8b6-f6806b22161f req-aaa04521-ccb8-47a8-be3f-9bdcaeb73233 service nova] [instance: 4d78e23e-b1d9-4395-9885-c515e558f673] Received event network-vif-deleted-f91e5406-2b2a-45e8-86a4-81edc6a8a06f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updating instance_info_cache with network_info: [{"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Releasing lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Instance network_info: |[{"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] Acquired lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Refreshing network info cache for port f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updated VIF entry in instance network info cache for port f7d1b16d-5c97-4c76-b9ca-dc0bd103288e. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updating instance_info_cache with network_info: [{"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a539f4aa-ca9c-4814-b893-5a3732a281df req-da9de926-8255-4d76-8d40-4171660f5644 service nova] Releasing lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:45:23 user nova-compute[75648]: INFO nova.compute.claims [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Claim successful on node user
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'flavor' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.161s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:23 user nova-compute[75648]: INFO nova.compute.manager [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Attaching volume e59916ca-98db-4212-980b-cf1081099a61 to /dev/vdb
Nov 15 05:45:23 user nova-compute[75648]: DEBUG os_brick.utils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1694672b-8020-49f6-8af8-0605016986bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0eb7ed-255a-4a26-8f74-74fe92f87dba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c98ecb-9f7f-45c7-80c6-754363afdc02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b8099-969a-458d-8543-abd7a4dd98fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:45:23 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[342228cd-ba64-48c7-aa60-d455aa62f52c]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG os_brick.utils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating existing volume attachment record: 9ada218f-c07f-4c7f-82e6-eff7574b8e35 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.707s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.network.neutron [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:45:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:45:23 user nova-compute[75648]: DEBUG nova.policy [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '143f1f9cdbe649ad9827f6b2ea96caeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27934c845b394f498de55243765a8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:45:24 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Creating image(s)
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "/opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "/opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "/opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk 1073741824" returned: 0 in 0.048s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Successfully created port: ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Cannot resize image /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Ensure instance console log exists: /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Successfully updated port: ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquired lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-changed-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Refreshing instance network info cache due to event network-changed-ce1f1809-0c98-4469-a733-6bf3ccd594e3. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] Acquiring lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updating instance_info_cache with network_info: [{"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Releasing lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Instance network_info: |[{"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] Acquired lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Refreshing network info cache for port ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Start _get_guest_xml network_info=[{"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:45:25 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:25 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1676507330',display_name='tempest-ServersNegativeTestJSON-server-1676507330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1676507330',id=24,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27934c845b394f498de55243765a8f51',ramdisk_id='',reservation_id='r-5fcc29d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712721745',owner_user_name='tempest-ServersNegativeTestJSON-1712721745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:45:24Z,user_data=None,user_id='143f1f9cdbe649ad9827f6b2ea96caeb',uuid=0aea1f03-161c-4b04-bee9-e0453ac6a110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converting VIF {"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.objects.instance [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lazy-loading 'pci_devices' on Instance uuid 0aea1f03-161c-4b04-bee9-e0453ac6a110 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:45:25 user nova-compute[75648]:   <uuid>0aea1f03-161c-4b04-bee9-e0453ac6a110</uuid>
Nov 15 05:45:25 user nova-compute[75648]:   <name>instance-00000018</name>
Nov 15 05:45:25 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:45:25 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:45:25 user nova-compute[75648]:   <metadata>
Nov 15 05:45:25 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:45:25 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:45:25 user nova-compute[75648]:       <nova:name>tempest-ServersNegativeTestJSON-server-1676507330</nova:name>
Nov 15 05:45:25 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:45:25</nova:creationTime>
Nov 15 05:45:25 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:45:25 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:45:25 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:45:25 user nova-compute[75648]:       <nova:owner>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:user uuid="143f1f9cdbe649ad9827f6b2ea96caeb">tempest-ServersNegativeTestJSON-1712721745-project-member</nova:user>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:project uuid="27934c845b394f498de55243765a8f51">tempest-ServersNegativeTestJSON-1712721745</nova:project>
Nov 15 05:45:25 user nova-compute[75648]:       </nova:owner>
Nov 15 05:45:25 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:45:25 user nova-compute[75648]:       <nova:ports>
Nov 15 05:45:25 user nova-compute[75648]:         <nova:port uuid="ce1f1809-0c98-4469-a733-6bf3ccd594e3">
Nov 15 05:45:25 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 05:45:25 user nova-compute[75648]:         </nova:port>
Nov 15 05:45:25 user nova-compute[75648]:       </nova:ports>
Nov 15 05:45:25 user nova-compute[75648]:     </nova:instance>
Nov 15 05:45:25 user nova-compute[75648]:   </metadata>
Nov 15 05:45:25 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:45:25 user nova-compute[75648]:     <system>
Nov 15 05:45:25 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:45:25 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:45:25 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:45:25 user nova-compute[75648]:       <entry name="serial">0aea1f03-161c-4b04-bee9-e0453ac6a110</entry>
Nov 15 05:45:25 user nova-compute[75648]:       <entry name="uuid">0aea1f03-161c-4b04-bee9-e0453ac6a110</entry>
Nov 15 05:45:25 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:45:25 user nova-compute[75648]:     </system>
Nov 15 05:45:25 user nova-compute[75648]:   </sysinfo>
Nov 15 05:45:25 user nova-compute[75648]:   <os>
Nov 15 05:45:25 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:45:25 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:45:25 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:45:25 user nova-compute[75648]:   </os>
Nov 15 05:45:25 user nova-compute[75648]:   <features>
Nov 15 05:45:25 user nova-compute[75648]:     <acpi/>
Nov 15 05:45:25 user nova-compute[75648]:     <apic/>
Nov 15 05:45:25 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:45:25 user nova-compute[75648]:   </features>
Nov 15 05:45:25 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:45:25 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:45:25 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:45:25 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:45:25 user nova-compute[75648]:   </clock>
Nov 15 05:45:25 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:45:25 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:45:25 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:45:25 user nova-compute[75648]:   </cpu>
Nov 15 05:45:25 user nova-compute[75648]:   <devices>
Nov 15 05:45:25 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:45:25 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:45:25 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk"/>
Nov 15 05:45:25 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:45:25 user nova-compute[75648]:     </disk>
Nov 15 05:45:25 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:45:25 user nova-compute[75648]:       <mac address="fa:16:3e:d8:79:20"/>
Nov 15 05:45:25 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:45:25 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:45:25 user nova-compute[75648]:       <target dev="tapce1f1809-0c"/>
Nov 15 05:45:25 user nova-compute[75648]:     </interface>
Nov 15 05:45:25 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:45:25 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/console.log" append="off"/>
Nov 15 05:45:25 user nova-compute[75648]:     </serial>
Nov 15 05:45:25 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:45:25 user nova-compute[75648]:     <video>
Nov 15 05:45:25 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:45:25 user nova-compute[75648]:     </video>
Nov 15 05:45:25 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:45:25 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:45:25 user nova-compute[75648]:     </rng>
Nov 15 05:45:25 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:45:25 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:45:25 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:45:25 user nova-compute[75648]:     </memballoon>
Nov 15 05:45:25 user nova-compute[75648]:   </devices>
Nov 15 05:45:25 user nova-compute[75648]: </domain>
Nov 15 05:45:25 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1676507330',display_name='tempest-ServersNegativeTestJSON-server-1676507330',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1676507330',id=24,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27934c845b394f498de55243765a8f51',ramdisk_id='',reservation_id='r-5fcc29d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712721745',owner_user_name='tempest-ServersNegativeTestJSON-1712721745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:45:24Z,user_data=None,user_id='143f1f9cdbe649ad9827f6b2ea96caeb',uuid=0aea1f03-161c-4b04-bee9-e0453ac6a110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converting VIF {"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_vif [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2045f065-ce2a-5442-b394-02d25ba0aac9', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapce1f1809-0c, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapce1f1809-0c, col_values=(('qos', UUID('d92e9f2c-a34b-4839-8857-a92a9a4ab3f5')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapce1f1809-0c, col_values=(('external_ids', {'iface-id': 'ce1f1809-0c98-4469-a733-6bf3ccd594e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:79:20', 'vm-uuid': '0aea1f03-161c-4b04-bee9-e0453ac6a110'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:25 user nova-compute[75648]: INFO os_vif [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c')
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] No VIF found with MAC fa:16:3e:d8:79:20, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_brick.utils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5cffa4-e3f6-48ab-9105-84c609eae1df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bf09db-42be-4fc4-a718-7b2873b04f8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0b7b3c-5790-4478-8e70-c3be6e7b4047]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3b189-1abc-49d5-a3e9-38a283e3d31b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:45:25 user nova-compute[75648]: INFO nova.compute.manager [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Unrescuing
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:45:25 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:45:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef63007-339a-4b80-a48b-1295efe6ed04]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG os_brick.utils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updating existing volume attachment record: b769af79-7b7e-4c7e-b966-7f17d9440952 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updated VIF entry in instance network info cache for port ce1f1809-0c98-4469-a733-6bf3ccd594e3. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:45:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updating instance_info_cache with network_info: [{"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5edfcd5b-1594-44b2-b9dc-bca404740d4d req-2e8ef556-9bc4-4c89-8f03-73b8ec97fd75 service nova] Releasing lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG nova.network.neutron [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG nova.objects.instance [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'flavor' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_power_states {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae51ae63-52ca-4b89-b8af-908dbf7396b8 req-a0b66dc5-403f-478b-a0a7-ca2f0fa592f7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae51ae63-52ca-4b89-b8af-908dbf7396b8 req-a0b66dc5-403f-478b-a0a7-ca2f0fa592f7 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae51ae63-52ca-4b89-b8af-908dbf7396b8 req-a0b66dc5-403f-478b-a0a7-ca2f0fa592f7 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae51ae63-52ca-4b89-b8af-908dbf7396b8 req-a0b66dc5-403f-478b-a0a7-ca2f0fa592f7 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae51ae63-52ca-4b89-b8af-908dbf7396b8 req-a0b66dc5-403f-478b-a0a7-ca2f0fa592f7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:26 user nova-compute[75648]: WARNING nova.compute.manager [req-ae51ae63-52ca-4b89-b8af-908dbf7396b8 req-a0b66dc5-403f-478b-a0a7-ca2f0fa592f7 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-unplugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-3df8cf63-40cf-4c46-bec2-ca0918b05b82 req-432149d3-019f-4ebd-83f5-c12726a5fbc0 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3df8cf63-40cf-4c46-bec2-ca0918b05b82 req-432149d3-019f-4ebd-83f5-c12726a5fbc0 service nova] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3df8cf63-40cf-4c46-bec2-ca0918b05b82 req-432149d3-019f-4ebd-83f5-c12726a5fbc0 service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3df8cf63-40cf-4c46-bec2-ca0918b05b82 req-432149d3-019f-4ebd-83f5-c12726a5fbc0 service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-3df8cf63-40cf-4c46-bec2-ca0918b05b82 req-432149d3-019f-4ebd-83f5-c12726a5fbc0 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] No waiting events found dispatching network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:27 user nova-compute[75648]: WARNING nova.compute.manager [req-3df8cf63-40cf-4c46-bec2-ca0918b05b82 req-432149d3-019f-4ebd-83f5-c12726a5fbc0 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received unexpected event network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 for instance with vm_state building and task_state spawning.
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance destroyed successfully.
Nov 15 05:45:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:28 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:28 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:28 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-2bf4fefd-7f5d-492b-bbe2-15447a04c2a8 req-0d39e2b2-bef3-4480-af51-2bdf94f994ef service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2bf4fefd-7f5d-492b-bbe2-15447a04c2a8 req-0d39e2b2-bef3-4480-af51-2bdf94f994ef service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2bf4fefd-7f5d-492b-bbe2-15447a04c2a8 req-0d39e2b2-bef3-4480-af51-2bdf94f994ef service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2bf4fefd-7f5d-492b-bbe2-15447a04c2a8 req-0d39e2b2-bef3-4480-af51-2bdf94f994ef service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-2bf4fefd-7f5d-492b-bbe2-15447a04c2a8 req-0d39e2b2-bef3-4480-af51-2bdf94f994ef service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:28 user nova-compute[75648]: WARNING nova.compute.manager [req-2bf4fefd-7f5d-492b-bbe2-15447a04c2a8 req-0d39e2b2-bef3-4480-af51-2bdf94f994ef service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d25e0ad9-6471-4707-a106-6a2893f4020a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:45:28 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bf6413-ad3a-46be-b480-d37539ffd66f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61] added
Nov 15 05:45:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb554ecc-3b7e-43d3-9637-20b2ab669e26]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7a7edb-1d7c-4515-a23c-3b4658bfbab9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbKCZtJd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbKCZtJd" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4040a63-501f-41e5-a8e1-943b5c306665]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbKCZtJd'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d88718b-0071-4a32-8f25-a19d19d74ee5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c905236-769d-44d3-84e7-84bea25a4571]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:28 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:28 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:28 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:28 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:28 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:28 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9c6996-4144-41ce-a26d-5c0babeb2946]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]
Nov 15 05:45:29 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[760df635-e6eb-42b0-ab00-14c07887e564]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab104b52-31fd-4d02-afcb-3f32ce96c01d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:29 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f9b205-7b37-47f7-8367-5f04a479b600]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-a0b7d741-0395-4419-ba0c-83eca820dca7 req-c89f802b-0bd7-4eed-882f-d5520440bb34 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a0b7d741-0395-4419-ba0c-83eca820dca7 req-c89f802b-0bd7-4eed-882f-d5520440bb34 service nova] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a0b7d741-0395-4419-ba0c-83eca820dca7 req-c89f802b-0bd7-4eed-882f-d5520440bb34 service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a0b7d741-0395-4419-ba0c-83eca820dca7 req-c89f802b-0bd7-4eed-882f-d5520440bb34 service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-a0b7d741-0395-4419-ba0c-83eca820dca7 req-c89f802b-0bd7-4eed-882f-d5520440bb34 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] No waiting events found dispatching network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:29 user nova-compute[75648]: WARNING nova.compute.manager [req-a0b7d741-0395-4419-ba0c-83eca820dca7 req-c89f802b-0bd7-4eed-882f-d5520440bb34 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received unexpected event network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 for instance with vm_state building and task_state spawning.
Nov 15 05:45:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:29 user nova-compute[75648]: WARNING nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] While synchronizing instance power states, found 14 instances in the database and 13 instances on the hypervisor.
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid f66dc876-aae4-4e20-8b96-c47a8e3dff60 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid c0d5e58b-f341-43bc-bfd4-e59eec2c1064 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid d2e87c21-9cc6-43c2-a954-ba12eec2b0ee {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid ea504b50-f1d5-4241-b01b-67beb3d15879 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 108cc4d3-aeab-4419-8cae-d5195cc5b0e8 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 0aea1f03-161c-4b04-bee9-e0453ac6a110 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: INFO nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23338336637326634', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338336637326634', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'flavor' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:45:30 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:45:30 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:45:30 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:45:30 user nova-compute[75648]:   <serial>e59916ca-98db-4212-980b-cf1081099a61</serial>
Nov 15 05:45:30 user nova-compute[75648]: </disk>
Nov 15 05:45:30 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No VIF found with MAC fa:16:3e:31:38:3b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b786edb0-dcd1-487f-8885-7a3a82a28c3e tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.350s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.881s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:45:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Instance spawned successfully.
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:30 user nova-compute[75648]: WARNING nova.compute.manager [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] No waiting events found dispatching network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:30 user nova-compute[75648]: WARNING nova.compute.manager [req-67db7a38-13c4-4529-bbb1-fcf057eaf4b5 req-b546c7e5-18f8-4ee6-9dd5-2c862d4498b4 service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received unexpected event network-vif-plugged-563c8454-c7b5-4d8f-9c22-a8da90b69a3a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:30 user nova-compute[75648]: INFO nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Took 6.92 seconds to spawn the instance on the hypervisor.
Nov 15 05:45:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:45:31 user nova-compute[75648]: INFO nova.compute.manager [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Took 7.95 seconds to build instance.
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-51064f9a-fa43-4157-86d3-060a98802ccb tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.045s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.113s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:31 user nova-compute[75648]: INFO nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] During sync_power_state the instance has a pending task (spawning). Skip.
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:45:31 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Creating image(s)
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Ensure instance console log exists: /opt/stack/data/nova/instances/108cc4d3-aeab-4419-8cae-d5195cc5b0e8/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Start _get_guest_xml network_info=[{"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T05:45:14Z,direct_url=<?>,disk_format='qcow2',id=067f4566-c46a-4ea9-8672-a1bba02a6064,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-746261685',owner='bea832b577b9445782f27e28b1023e96',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T05:45:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'b769af79-7b7e-4c7e-b966-7f17d9440952', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcuKAjiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '108cc4d3-aeab-4419-8cae-d5195cc5b0e8', 'attached_at': '', 'detached_at': '', 'volume_id': '606c096e-9463-4cbf-9fd0-0cd92313f807', 'serial': '606c096e-9463-4cbf-9fd0-0cd92313f807'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-351b5d17-5f75-44ef-b80e-1569e888d32e tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:45:31 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:31 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-15T05:45:14Z,direct_url=<?>,disk_format='qcow2',id=067f4566-c46a-4ea9-8672-a1bba02a6064,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-746261685',owner='bea832b577b9445782f27e28b1023e96',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-15T05:45:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcuKAjiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:31 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:31 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:31 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:45:31 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c is timed out.
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:31 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Successfully detached device vdb from instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c from the live domain config.
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLzRGfBD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:31 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[61065c5f-ab67-4468-9d55-17e14884f6bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:45:31 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbb57bb-b66e-460b-9dde-257d7bd73f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807] added
Nov 15 05:45:31 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8082aa-c63d-4b2a-806d-b7f1d2bc403f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:31 user nova-compute[75648]: INFO nova.compute.manager [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Unrescuing
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6bc8f14-6d8b-43f4-8bc1-943ac2c3ccc4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:31 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcuKAjiV {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tcuKAjiV" returned: 0 in 0.046s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe15cca-2fda-4aa6-aaff-cc1ad003d406]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tcuKAjiV'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e01e0c-bef4-4e05-81e6-aeb7dede8135]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec89389a-add7-4021-8865-929c42e5cc91]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93dd2c32-eeee-4590-ba3d-a68e12c0bf29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260]
Nov 15 05:45:32 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:32 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f618c8-ffa6-4e34-ac1d-52e4967f2d67]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2dfd8b-1d39-4f51-9493-6b43d80c3374]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:32 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] HCTL ('38', '-', '-', 0) found on session 23 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[958de898-6336-41d2-a426-e0aee838520d]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 23 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcuKAjiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'flavor' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-53399e22-67ee-4355-9b22-7394eb29c0a0 req-bce44be8-1ad8-43ed-9b28-8ca4943a9849 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-53399e22-67ee-4355-9b22-7394eb29c0a0 req-bce44be8-1ad8-43ed-9b28-8ca4943a9849 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-53399e22-67ee-4355-9b22-7394eb29c0a0 req-bce44be8-1ad8-43ed-9b28-8ca4943a9849 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-53399e22-67ee-4355-9b22-7394eb29c0a0 req-bce44be8-1ad8-43ed-9b28-8ca4943a9849 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-53399e22-67ee-4355-9b22-7394eb29c0a0 req-bce44be8-1ad8-43ed-9b28-8ca4943a9849 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:32 user nova-compute[75648]: WARNING nova.compute.manager [req-53399e22-67ee-4355-9b22-7394eb29c0a0 req-bce44be8-1ad8-43ed-9b28-8ca4943a9849 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.438s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26562333439663033', 'path': '/dev/sdg'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562333439663033', 'path': '/dev/sdg'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.414s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b695a35f-be9e-4a0f-aafc-8bdfadad862e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:45:33 user nova-compute[75648]: No targets found.
Nov 15 05:45:33 user nova-compute[75648]: iSNS:
Nov 15 05:45:33 user nova-compute[75648]: No targets found.
Nov 15 05:45:33 user nova-compute[75648]: STATIC:
Nov 15 05:45:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626
Nov 15 05:45:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:45:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:45:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807
Nov 15 05:45:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:45:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:33 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:45:33 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:33 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:33 user nova-compute[75648]: FIRMWARE:
Nov 15 05:45:33 user nova-compute[75648]: No targets found.
Nov 15 05:45:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:45:33 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:45:33 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-795048212',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-795048212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-795048212',id=23,image_ref='067f4566-c46a-4ea9-8672-a1bba02a6064',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIc567VGRHceZmGGqFGxklK+uQqsDQf3N9K2qBiW2bGN+idYZxhw0E+w6dc4RXs1SWt59zsbLPakpv7QqMGyH2HfvAGhwEnwMKsrkd2bFuVKurdcLKzytsJc7z+Dfi7ng==',key_name='tempest-keypair-2046693849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-sldmqf5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-522670763',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=108cc4d3-aeab-4419-8cae-d5195cc5b0e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.objects.instance [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'pci_devices' on Instance uuid 108cc4d3-aeab-4419-8cae-d5195cc5b0e8 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:45:33 user nova-compute[75648]:   <uuid>108cc4d3-aeab-4419-8cae-d5195cc5b0e8</uuid>
Nov 15 05:45:33 user nova-compute[75648]:   <name>instance-00000017</name>
Nov 15 05:45:33 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:45:33 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:45:33 user nova-compute[75648]:   <metadata>
Nov 15 05:45:33 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:45:33 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:45:33 user nova-compute[75648]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-795048212</nova:name>
Nov 15 05:45:33 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:45:31</nova:creationTime>
Nov 15 05:45:33 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:45:33 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:45:33 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:45:33 user nova-compute[75648]:       <nova:owner>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:user uuid="2fd4a8513df14fc7ab09905d24220ae1">tempest-TestVolumeBootPattern-522670763-project-member</nova:user>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:project uuid="bea832b577b9445782f27e28b1023e96">tempest-TestVolumeBootPattern-522670763</nova:project>
Nov 15 05:45:33 user nova-compute[75648]:       </nova:owner>
Nov 15 05:45:33 user nova-compute[75648]:       <nova:root type="image" uuid="067f4566-c46a-4ea9-8672-a1bba02a6064"/>
Nov 15 05:45:33 user nova-compute[75648]:       <nova:ports>
Nov 15 05:45:33 user nova-compute[75648]:         <nova:port uuid="f7d1b16d-5c97-4c76-b9ca-dc0bd103288e">
Nov 15 05:45:33 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:45:33 user nova-compute[75648]:         </nova:port>
Nov 15 05:45:33 user nova-compute[75648]:       </nova:ports>
Nov 15 05:45:33 user nova-compute[75648]:     </nova:instance>
Nov 15 05:45:33 user nova-compute[75648]:   </metadata>
Nov 15 05:45:33 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:45:33 user nova-compute[75648]:     <system>
Nov 15 05:45:33 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:45:33 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:45:33 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:45:33 user nova-compute[75648]:       <entry name="serial">108cc4d3-aeab-4419-8cae-d5195cc5b0e8</entry>
Nov 15 05:45:33 user nova-compute[75648]:       <entry name="uuid">108cc4d3-aeab-4419-8cae-d5195cc5b0e8</entry>
Nov 15 05:45:33 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:45:33 user nova-compute[75648]:     </system>
Nov 15 05:45:33 user nova-compute[75648]:   </sysinfo>
Nov 15 05:45:33 user nova-compute[75648]:   <os>
Nov 15 05:45:33 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:45:33 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:45:33 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:45:33 user nova-compute[75648]:   </os>
Nov 15 05:45:33 user nova-compute[75648]:   <features>
Nov 15 05:45:33 user nova-compute[75648]:     <acpi/>
Nov 15 05:45:33 user nova-compute[75648]:     <apic/>
Nov 15 05:45:33 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:45:33 user nova-compute[75648]:   </features>
Nov 15 05:45:33 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:45:33 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:45:33 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:45:33 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:45:33 user nova-compute[75648]:   </clock>
Nov 15 05:45:33 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:45:33 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:45:33 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:45:33 user nova-compute[75648]:   </cpu>
Nov 15 05:45:33 user nova-compute[75648]:   <devices>
Nov 15 05:45:33 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:45:33 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:45:33 user nova-compute[75648]:       <source dev="/dev/sdg"/>
Nov 15 05:45:33 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:45:33 user nova-compute[75648]:       <serial>606c096e-9463-4cbf-9fd0-0cd92313f807</serial>
Nov 15 05:45:33 user nova-compute[75648]:     </disk>
Nov 15 05:45:33 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:45:33 user nova-compute[75648]:       <mac address="fa:16:3e:f5:b1:82"/>
Nov 15 05:45:33 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:45:33 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:45:33 user nova-compute[75648]:       <target dev="tapf7d1b16d-5c"/>
Nov 15 05:45:33 user nova-compute[75648]:     </interface>
Nov 15 05:45:33 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:45:33 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/108cc4d3-aeab-4419-8cae-d5195cc5b0e8/console.log" append="off"/>
Nov 15 05:45:33 user nova-compute[75648]:     </serial>
Nov 15 05:45:33 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:45:33 user nova-compute[75648]:     <video>
Nov 15 05:45:33 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:45:33 user nova-compute[75648]:     </video>
Nov 15 05:45:33 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:45:33 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:45:33 user nova-compute[75648]:     </rng>
Nov 15 05:45:33 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:45:33 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:45:33 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:45:33 user nova-compute[75648]:     </memballoon>
Nov 15 05:45:33 user nova-compute[75648]:   </devices>
Nov 15 05:45:33 user nova-compute[75648]: </domain>
Nov 15 05:45:33 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-795048212',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-795048212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-795048212',id=23,image_ref='067f4566-c46a-4ea9-8672-a1bba02a6064',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIc567VGRHceZmGGqFGxklK+uQqsDQf3N9K2qBiW2bGN+idYZxhw0E+w6dc4RXs1SWt59zsbLPakpv7QqMGyH2HfvAGhwEnwMKsrkd2bFuVKurdcLKzytsJc7z+Dfi7ng==',key_name='tempest-keypair-2046693849',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-sldmqf5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-522670763',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=108cc4d3-aeab-4419-8cae-d5195cc5b0e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_vif [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[988aaf9c-9c7f-48e2-a395-92a8ef511b83]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '08a138ae-d87a-545b-bb7a-2a96341d346e', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7d1b16d-5c, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7d1b16d-5c, col_values=(('qos', UUID('18812f3e-b2db-4baf-ac3a-900bb958a8bf')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7d1b16d-5c, col_values=(('external_ids', {'iface-id': 'f7d1b16d-5c97-4c76-b9ca-dc0bd103288e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:b1:82', 'vm-uuid': '108cc4d3-aeab-4419-8cae-d5195cc5b0e8'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d0a7d4-99b4-4f38-84cf-059d7e323894]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8589750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:33 user nova-compute[75648]: INFO os_vif [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c')
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1557ad7-3873-4766-8904-c702a1399605]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad048b7-b50d-45b9-97f7-408e4fc483e7]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance destroyed successfully.
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[73acda6e-2511-41c0-8bcb-20926eb2132d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No VIF found with MAC fa:16:3e:f5:b1:82, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b292c19b-c15e-42e4-af88-76aa4c226835]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e31f952-da40-4859-8fb1-7cf7cbd4955b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1867d1a2-3e99-498c-be78-a41339dba3c9]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260]
Nov 15 05:45:33 user nova-compute[75648]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:33 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc9a592b-3819-402e-ac1c-cca273cc1626 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3393f495-a526-4fc7-a835-3aafc8169592]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.420s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] <== disconnect_volume: return (1836ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.006s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:34 user nova-compute[75648]: INFO nova.compute.manager [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Terminating instance
Nov 15 05:45:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'flavor' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-34075965-5b4d-43a9-a537-9ce598673bb8 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.421s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.819s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:35 user nova-compute[75648]: WARNING nova.compute.manager [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-vif-unplugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] No waiting events found dispatching network-vif-unplugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-82974ab8-0b76-4280-860d-948c84515cff req-fa5e40cd-6c07-4947-a154-6e6a962619b0 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-vif-unplugged-a978183e-0aa7-4637-9017-dae4f9d46de4 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing instance network info cache due to event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.network.neutron [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updated VIF entry in instance network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.network.neutron [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-905ff8ef-98e6-4c4d-bb77-cba70e111ee3 req-f57cb5e5-1699-4662-b235-40b8ea6db45d service nova] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-a8fe4a38-8669-491d-8f78-88f8b0aa449b req-e4317f03-4775-4d4a-93f6-4d2df1bb74b9 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a8fe4a38-8669-491d-8f78-88f8b0aa449b req-e4317f03-4775-4d4a-93f6-4d2df1bb74b9 service nova] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a8fe4a38-8669-491d-8f78-88f8b0aa449b req-e4317f03-4775-4d4a-93f6-4d2df1bb74b9 service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a8fe4a38-8669-491d-8f78-88f8b0aa449b req-e4317f03-4775-4d4a-93f6-4d2df1bb74b9 service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-a8fe4a38-8669-491d-8f78-88f8b0aa449b req-e4317f03-4775-4d4a-93f6-4d2df1bb74b9 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] No waiting events found dispatching network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:36 user nova-compute[75648]: WARNING nova.compute.manager [req-a8fe4a38-8669-491d-8f78-88f8b0aa449b req-e4317f03-4775-4d4a-93f6-4d2df1bb74b9 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received unexpected event network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e for instance with vm_state building and task_state spawning.
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Instance destroyed successfully.
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lazy-loading 'resources' on Instance uuid ea504b50-f1d5-4241-b01b-67beb3d15879 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1723119768',display_name='tempest-VolumesActionsTest-instance-1723119768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1723119768',id=20,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d80c0c4fdf674d108496b63cd67ac2af',ramdisk_id='',reservation_id='r-j860kb6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1279806277',owner_user_name='tempest-VolumesActionsTest-1279806277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:43:53Z,user_data=None,user_id='233bc61e55934b57bf40084001640bb3',uuid=ea504b50-f1d5-4241-b01b-67beb3d15879,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converting VIF {"id": "a978183e-0aa7-4637-9017-dae4f9d46de4", "address": "fa:16:3e:4f:64:58", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa978183e-0a", "ovs_interfaceid": "a978183e-0aa7-4637-9017-dae4f9d46de4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG os_vif [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa978183e-0a, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83249606-2192-4fc1-ad14-6006bed6139d) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:37 user nova-compute[75648]: INFO os_vif [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:64:58,bridge_name='br-int',has_traffic_filtering=True,id=a978183e-0aa7-4637-9017-dae4f9d46de4,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa978183e-0a')
Nov 15 05:45:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Deleting instance files /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879_del
Nov 15 05:45:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Deletion of /opt/stack/data/nova/instances/ea504b50-f1d5-4241-b01b-67beb3d15879_del complete
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] Acquiring lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] No waiting events found dispatching network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:37 user nova-compute[75648]: WARNING nova.compute.manager [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received unexpected event network-vif-plugged-a978183e-0aa7-4637-9017-dae4f9d46de4 for instance with vm_state active and task_state deleting.
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:37 user nova-compute[75648]: WARNING nova.compute.manager [req-ca2d9db9-4893-4ff9-9cba-e29911eecaf9 req-b4422eff-0f68-44de-978d-0812d6c4e1e1 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:37 user nova-compute[75648]: INFO nova.compute.manager [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Took 2.56 seconds to destroy the instance on the hypervisor.
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:37 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Took 0.59 seconds to deallocate network for instance.
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:38 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Deleted allocations for instance ea504b50-f1d5-4241-b01b-67beb3d15879
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e9df2004-2e8a-4b86-80b7-a628e04aa0d6 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "ea504b50-f1d5-4241-b01b-67beb3d15879" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.903s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] No waiting events found dispatching network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:38 user nova-compute[75648]: WARNING nova.compute.manager [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received unexpected event network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e for instance with vm_state building and task_state spawning.
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: ea504b50-f1d5-4241-b01b-67beb3d15879] Received event network-vif-deleted-a978183e-0aa7-4637-9017-dae4f9d46de4 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing instance network info cache due to event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:38 user nova-compute[75648]: DEBUG nova.network.neutron [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.network.neutron [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updated VIF entry in instance network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.network.neutron [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-824f3927-69b3-42fb-aac3-da50901cabf5 req-4a977403-c1d2-43f9-b6f1-417162ccf49b service nova] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.compute.manager [req-a844f135-da4f-403c-a197-d92f92337d09 req-d176b234-b9da-457c-a717-81331555187c service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a844f135-da4f-403c-a197-d92f92337d09 req-d176b234-b9da-457c-a717-81331555187c service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a844f135-da4f-403c-a197-d92f92337d09 req-d176b234-b9da-457c-a717-81331555187c service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a844f135-da4f-403c-a197-d92f92337d09 req-d176b234-b9da-457c-a717-81331555187c service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.compute.manager [req-a844f135-da4f-403c-a197-d92f92337d09 req-d176b234-b9da-457c-a717-81331555187c service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:39 user nova-compute[75648]: WARNING nova.compute.manager [req-a844f135-da4f-403c-a197-d92f92337d09 req-d176b234-b9da-457c-a717-81331555187c service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a6e40a33-8795-4f55-9996-059b4c001fa1 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:45:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Instance spawned successfully.
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:45:39 user nova-compute[75648]: INFO nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Took 7.61 seconds to spawn the instance on the hypervisor.
Nov 15 05:45:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:45:39 user nova-compute[75648]: INFO nova.compute.manager [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Took 20.48 seconds to build instance.
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-07b3bf53-de3b-49b1-896e-b587a20a269d tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.582s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.552s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:39 user nova-compute[75648]: INFO nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 15 05:45:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:41 user nova-compute[75648]: INFO nova.compute.manager [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Rebooting instance
Nov 15 05:45:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.compute.manager [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-0fcfba56-ebd1-4695-b1fb-b75d3ce49987 req-7033778f-fdc3-48e2-9a85-0ff5c9feecd5 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-unplugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0fcfba56-ebd1-4695-b1fb-b75d3ce49987 req-7033778f-fdc3-48e2-9a85-0ff5c9feecd5 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0fcfba56-ebd1-4695-b1fb-b75d3ce49987 req-7033778f-fdc3-48e2-9a85-0ff5c9feecd5 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0fcfba56-ebd1-4695-b1fb-b75d3ce49987 req-7033778f-fdc3-48e2-9a85-0ff5c9feecd5 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-0fcfba56-ebd1-4695-b1fb-b75d3ce49987 req-7033778f-fdc3-48e2-9a85-0ff5c9feecd5 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-unplugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:42 user nova-compute[75648]: WARNING nova.compute.manager [req-0fcfba56-ebd1-4695-b1fb-b75d3ce49987 req-7033778f-fdc3-48e2-9a85-0ff5c9feecd5 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-unplugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state active and task_state reboot_started_hard.
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance destroyed successfully.
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.objects.instance [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'resources' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1312046518',display_name='tempest-TestMinimumBasicScenario-server-1312046518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1312046518',id=19,image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI1HOtaiCSAxyXom2SzZVLqtMwnYcysv+cn0KFAKSfgS4wkwlRPGpAVRAhOmmoubEgzy8jADoPs6wnsWI3faIzmsFLbexUqVTAcCmfzrz4KjqlU2YQNohn5aMa7T+PAQg==',key_name='tempest-TestMinimumBasicScenario-973469601',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ds02yl35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:42Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=40448f79-0cbc-462a-be88-050f97128a07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG os_vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae26706e-32, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c69ea878-c5c8-4c89-819c-3c0a612acac5) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:42 user nova-compute[75648]: INFO os_vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32')
Nov 15 05:45:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:42 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9448d5-9128-4e7e-be43-e9df99bb7d13]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:45:43 user nova-compute[75648]: No targets found.
Nov 15 05:45:43 user nova-compute[75648]: iSNS:
Nov 15 05:45:43 user nova-compute[75648]: No targets found.
Nov 15 05:45:43 user nova-compute[75648]: STATIC:
Nov 15 05:45:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:45:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:45:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807
Nov 15 05:45:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:45:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:45:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:43 user nova-compute[75648]: FIRMWARE:
Nov 15 05:45:43 user nova-compute[75648]: No targets found.
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:45:43 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:45:43 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff28049c-b5db-4e1a-8f9a-682d23632a4e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3a89a9-ce4c-473a-9a90-8f162d65d064]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8611000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4634437-4ba5-48cb-9f46-018123722f12]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c287f3-cae8-4711-8451-356e254f89da]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce90d4a-8c36-4632-b9ff-a089894ff9eb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6d0671-5c8a-4c3a-89f3-55c022ff6df8]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[118e216f-26b9-43ef-a886-92b18230d336]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f3e848-a132-47be-b937-aef822a94833]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]
Nov 15 05:45:43 user nova-compute[75648]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb8e271-27e8-4819-9a69-fcf9ef901eaa]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== disconnect_volume: return (327ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Start _get_guest_xml network_info=[{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e0af5aca-7cfb-4309-89cd-1fb08884ac1f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': 'e0af5aca-7cfb-4309-89cd-1fb08884ac1f'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '9ada218f-c07f-4c7f-82e6-eff7574b8e35', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '40448f79-0cbc-462a-be88-050f97128a07', 'attached_at': '', 'detached_at': '', 'volume_id': 'e59916ca-98db-4212-980b-cf1081099a61', 'serial': 'e59916ca-98db-4212-980b-cf1081099a61'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:45:43 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:43 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e0af5aca-7cfb-4309-89cd-1fb08884ac1f,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.objects.instance [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'vcpu_model' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.objects.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Object Instance<40448f79-0cbc-462a-be88-050f97128a07> lazy-loaded attributes: resources,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:43 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa953f1f-13fc-47d9-9064-f1db842e7eaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:45:43 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4774e54-384e-4d04-b165-b0abc6ae3413]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61] added
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[54266505-cbff-4fca-a3d0-0b8ca860acc0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[45595a6c-eccf-4cca-b81b-10e1ca56a4c8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbKCZtJd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QbKCZtJd" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[36669050-461a-4f29-8830-789871e26d5b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QbKCZtJd'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f21cac-ba14-4401-9f33-4250aaba9808]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[866258a4-f32b-4de1-89d9-d19fe7936cfc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ffc126-6200-4c3d-9ac5-3dac8886438b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]
Nov 15 05:45:43 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcca4ea-cd41-47fb-8b0a-348e8ac7abf0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc1bef-04be-4792-87db-01c7dc9a274e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82279fe-c75c-4631-8737-130e2db183f6]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-741559b0-1dcc-4131-a1cd-fcecfb39b2e8 req-0b78ab39-7c9b-4cf6-9a45-f6e8a43861e8 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-741559b0-1dcc-4131-a1cd-fcecfb39b2e8 req-0b78ab39-7c9b-4cf6-9a45-f6e8a43861e8 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-741559b0-1dcc-4131-a1cd-fcecfb39b2e8 req-0b78ab39-7c9b-4cf6-9a45-f6e8a43861e8 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-741559b0-1dcc-4131-a1cd-fcecfb39b2e8 req-0b78ab39-7c9b-4cf6-9a45-f6e8a43861e8 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-741559b0-1dcc-4131-a1cd-fcecfb39b2e8 req-0b78ab39-7c9b-4cf6-9a45-f6e8a43861e8 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:44 user nova-compute[75648]: WARNING nova.compute.manager [req-741559b0-1dcc-4131-a1cd-fcecfb39b2e8 req-0b78ab39-7c9b-4cf6-9a45-f6e8a43861e8 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state active and task_state reboot_started_hard.
Nov 15 05:45:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23338336637326634', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338336637326634', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1312046518',display_name='tempest-TestMinimumBasicScenario-server-1312046518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1312046518',id=19,image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI1HOtaiCSAxyXom2SzZVLqtMwnYcysv+cn0KFAKSfgS4wkwlRPGpAVRAhOmmoubEgzy8jADoPs6wnsWI3faIzmsFLbexUqVTAcCmfzrz4KjqlU2YQNohn5aMa7T+PAQg==',key_name='tempest-TestMinimumBasicScenario-973469601',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ds02yl35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:42Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=40448f79-0cbc-462a-be88-050f97128a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'pci_devices' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.objects.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Object Instance<40448f79-0cbc-462a-be88-050f97128a07> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:45:44 user nova-compute[75648]:   <uuid>40448f79-0cbc-462a-be88-050f97128a07</uuid>
Nov 15 05:45:44 user nova-compute[75648]:   <name>instance-00000013</name>
Nov 15 05:45:44 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:45:44 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:45:44 user nova-compute[75648]:   <metadata>
Nov 15 05:45:44 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:45:44 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:45:44 user nova-compute[75648]:       <nova:name>tempest-TestMinimumBasicScenario-server-1312046518</nova:name>
Nov 15 05:45:44 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:45:43</nova:creationTime>
Nov 15 05:45:44 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:45:44 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:45:44 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:45:44 user nova-compute[75648]:       <nova:owner>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:user uuid="b0aa1627a1bf4e0abc6618d6ecbe5944">tempest-TestMinimumBasicScenario-623726925-project-member</nova:user>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:project uuid="abd3f0cb9d1048e899c02994b977bec3">tempest-TestMinimumBasicScenario-623726925</nova:project>
Nov 15 05:45:44 user nova-compute[75648]:       </nova:owner>
Nov 15 05:45:44 user nova-compute[75648]:       <nova:root type="image" uuid="e0af5aca-7cfb-4309-89cd-1fb08884ac1f"/>
Nov 15 05:45:44 user nova-compute[75648]:       <nova:ports>
Nov 15 05:45:44 user nova-compute[75648]:         <nova:port uuid="ae26706e-3298-4eb3-a239-efe30a80ab1f">
Nov 15 05:45:44 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:45:44 user nova-compute[75648]:         </nova:port>
Nov 15 05:45:44 user nova-compute[75648]:       </nova:ports>
Nov 15 05:45:44 user nova-compute[75648]:     </nova:instance>
Nov 15 05:45:44 user nova-compute[75648]:   </metadata>
Nov 15 05:45:44 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:45:44 user nova-compute[75648]:     <system>
Nov 15 05:45:44 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:45:44 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:45:44 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:45:44 user nova-compute[75648]:       <entry name="serial">40448f79-0cbc-462a-be88-050f97128a07</entry>
Nov 15 05:45:44 user nova-compute[75648]:       <entry name="uuid">40448f79-0cbc-462a-be88-050f97128a07</entry>
Nov 15 05:45:44 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:45:44 user nova-compute[75648]:     </system>
Nov 15 05:45:44 user nova-compute[75648]:   </sysinfo>
Nov 15 05:45:44 user nova-compute[75648]:   <os>
Nov 15 05:45:44 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:45:44 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:45:44 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:45:44 user nova-compute[75648]:   </os>
Nov 15 05:45:44 user nova-compute[75648]:   <features>
Nov 15 05:45:44 user nova-compute[75648]:     <acpi/>
Nov 15 05:45:44 user nova-compute[75648]:     <apic/>
Nov 15 05:45:44 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:45:44 user nova-compute[75648]:   </features>
Nov 15 05:45:44 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:45:44 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:45:44 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:45:44 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:45:44 user nova-compute[75648]:   </clock>
Nov 15 05:45:44 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:45:44 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:45:44 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:45:44 user nova-compute[75648]:   </cpu>
Nov 15 05:45:44 user nova-compute[75648]:   <devices>
Nov 15 05:45:44 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:45:44 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:45:44 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk"/>
Nov 15 05:45:44 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:45:44 user nova-compute[75648]:     </disk>
Nov 15 05:45:44 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:45:44 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:45:44 user nova-compute[75648]:       <source dev="/dev/sdd"/>
Nov 15 05:45:44 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:45:44 user nova-compute[75648]:       <serial>e59916ca-98db-4212-980b-cf1081099a61</serial>
Nov 15 05:45:44 user nova-compute[75648]:     </disk>
Nov 15 05:45:44 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:45:44 user nova-compute[75648]:       <mac address="fa:16:3e:31:38:3b"/>
Nov 15 05:45:44 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:45:44 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:45:44 user nova-compute[75648]:       <target dev="tapae26706e-32"/>
Nov 15 05:45:44 user nova-compute[75648]:     </interface>
Nov 15 05:45:44 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:45:44 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/console.log" append="off"/>
Nov 15 05:45:44 user nova-compute[75648]:     </serial>
Nov 15 05:45:44 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:45:44 user nova-compute[75648]:     <video>
Nov 15 05:45:44 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:45:44 user nova-compute[75648]:     </video>
Nov 15 05:45:44 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:45:44 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:45:44 user nova-compute[75648]:     </rng>
Nov 15 05:45:44 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:45:44 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:45:44 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:45:44 user nova-compute[75648]:     </memballoon>
Nov 15 05:45:44 user nova-compute[75648]:   </devices>
Nov 15 05:45:44 user nova-compute[75648]: </domain>
Nov 15 05:45:44 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'trusted_certs' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Object Instance<40448f79-0cbc-462a-be88-050f97128a07> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-changed-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Refreshing instance network info cache due to event network-changed-c521ce3a-2c60-4c74-a3ce-ca8a2b194064. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] Acquiring lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] Acquired lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.network.neutron [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Refreshing network info cache for port c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027 --force-share --output=json" returned: 0 in 0.205s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:45 user nova-compute[75648]: INFO nova.compute.manager [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Terminating instance
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Cannot resize image /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'migration_context' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.objects.base [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Object Instance<40448f79-0cbc-462a-be88-050f97128a07> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1312046518',display_name='tempest-TestMinimumBasicScenario-server-1312046518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1312046518',id=19,image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI1HOtaiCSAxyXom2SzZVLqtMwnYcysv+cn0KFAKSfgS4wkwlRPGpAVRAhOmmoubEgzy8jADoPs6wnsWI3faIzmsFLbexUqVTAcCmfzrz4KjqlU2YQNohn5aMa7T+PAQg==',key_name='tempest-TestMinimumBasicScenario-973469601',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ds02yl35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:45:42Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=40448f79-0cbc-462a-be88-050f97128a07,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG os_vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b365afd-22a5-5adb-a652-9c3dbf312ccd', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae26706e-32, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapae26706e-32, col_values=(('qos', UUID('1800dc06-53d0-47e7-9ed8-b205b24930d3')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapae26706e-32, col_values=(('external_ids', {'iface-id': 'ae26706e-3298-4eb3-a239-efe30a80ab1f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:38:3b', 'vm-uuid': '40448f79-0cbc-462a-be88-050f97128a07'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: INFO os_vif [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32')
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-52ff7e25-21f2-40d5-985f-61378b07040e req-5542b9be-daac-443d-90a5-98b041fb6b9d service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-unplugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-52ff7e25-21f2-40d5-985f-61378b07040e req-5542b9be-daac-443d-90a5-98b041fb6b9d service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-52ff7e25-21f2-40d5-985f-61378b07040e req-5542b9be-daac-443d-90a5-98b041fb6b9d service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-52ff7e25-21f2-40d5-985f-61378b07040e req-5542b9be-daac-443d-90a5-98b041fb6b9d service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-52ff7e25-21f2-40d5-985f-61378b07040e req-5542b9be-daac-443d-90a5-98b041fb6b9d service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-unplugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-52ff7e25-21f2-40d5-985f-61378b07040e req-5542b9be-daac-443d-90a5-98b041fb6b9d service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-unplugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG nova.network.neutron [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updated VIF entry in instance network info cache for port c521ce3a-2c60-4c74-a3ce-ca8a2b194064. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG nova.network.neutron [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updating instance_info_cache with network_info: [{"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-97ed7397-1db7-4e9b-b5f8-71fe07aea123 req-40866e29-fd22-4f88-bdf8-99ef7a0248fe service nova] Releasing lock "refresh_cache-c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Instance destroyed successfully.
Nov 15 05:45:46 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'resources' on Instance uuid c2490dcd-e0e6-4032-9b61-72d32a1f5c8f {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-175056000',display_name='tempest-TestStampPattern-server-175056000',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-175056000',id=17,image_ref='c4947b38-9e55-4a7d-9e35-783fefba850e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoS16Y3HpfD0rY8HR4haBL7SzdPRoe0noXJF12ixXptNi3aAgE2AkkZArlpCa0FKKxvIhR6Hm0dXnO+kB90zMOmyhlZh1WRdqxONLK1loWH9Oj0yK5VWXCMdaCm6WMDVQ==',key_name='tempest-TestStampPattern-833870012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79b50966fa1c4fd78b0a555cb3afffee',ramdisk_id='',reservation_id='r-92wweo69',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1c801b45-ec7e-4f10-9443-6ab54528ab70',image_min_disk='1',image_min_ram='0',image_owner_id='79b50966fa1c4fd78b0a555cb3afffee',image_owner_project_name='tempest-TestStampPattern-591482588',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-591482588-project-member',image_user_id='4ae7fdd74e664596ab1a323e9c9347a5',owner_project_name='tempest-TestStampPattern-591482588',owner_user_name='tempest-TestStampPattern-591482588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:43:03Z,user_data=None,user_id='4ae7fdd74e664596ab1a323e9c9347a5',uuid=c2490dcd-e0e6-4032-9b61-72d32a1f5c8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converting VIF {"id": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "address": "fa:16:3e:7a:8b:2b", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc521ce3a-2c", "ovs_interfaceid": "c521ce3a-2c60-4c74-a3ce-ca8a2b194064", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG os_vif [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc521ce3a-2c, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=434e990a-2a45-4c5c-b1ed-45419cb9f49c) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: INFO os_vif [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:8b:2b,bridge_name='br-int',has_traffic_filtering=True,id=c521ce3a-2c60-4c74-a3ce-ca8a2b194064,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc521ce3a-2c')
Nov 15 05:45:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Deleting instance files /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f_del
Nov 15 05:45:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Deletion of /opt/stack/data/nova/instances/c2490dcd-e0e6-4032-9b61-72d32a1f5c8f_del complete
Nov 15 05:45:47 user nova-compute[75648]: INFO nova.compute.manager [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Took 1.74 seconds to destroy the instance on the hypervisor.
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:47 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Took 0.45 seconds to deallocate network for instance.
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-8589b9ef-e2d8-4286-87ca-5ea509a98caa req-12b07d5f-b90e-48f4-8ebe-4167bc9dda50 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8589b9ef-e2d8-4286-87ca-5ea509a98caa req-12b07d5f-b90e-48f4-8ebe-4167bc9dda50 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8589b9ef-e2d8-4286-87ca-5ea509a98caa req-12b07d5f-b90e-48f4-8ebe-4167bc9dda50 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8589b9ef-e2d8-4286-87ca-5ea509a98caa req-12b07d5f-b90e-48f4-8ebe-4167bc9dda50 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-8589b9ef-e2d8-4286-87ca-5ea509a98caa req-12b07d5f-b90e-48f4-8ebe-4167bc9dda50 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:47 user nova-compute[75648]: WARNING nova.compute.manager [req-8589b9ef-e2d8-4286-87ca-5ea509a98caa req-12b07d5f-b90e-48f4-8ebe-4167bc9dda50 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state active and task_state reboot_started_hard.
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:47 user nova-compute[75648]: WARNING nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state deleted and task_state None.
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:47 user nova-compute[75648]: WARNING nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state deleted and task_state None.
Nov 15 05:45:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:48 user nova-compute[75648]: WARNING nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state deleted and task_state None.
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-unplugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-unplugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:48 user nova-compute[75648]: WARNING nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-unplugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state deleted and task_state None.
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Acquiring lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] No waiting events found dispatching network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:48 user nova-compute[75648]: WARNING nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received unexpected event network-vif-plugged-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 for instance with vm_state deleted and task_state None.
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-d13028a6-e906-49e6-8da5-7e39752ea876 req-e55e3603-0fed-43e3-8785-bd60b6271079 service nova] [instance: c2490dcd-e0e6-4032-9b61-72d32a1f5c8f] Received event network-vif-deleted-c521ce3a-2c60-4c74-a3ce-ca8a2b194064 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:48 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Deleted allocations for instance c2490dcd-e0e6-4032-9b61-72d32a1f5c8f
Nov 15 05:45:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c6820139-4270-436b-a61c-b535fa660f9c tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "c2490dcd-e0e6-4032-9b61-72d32a1f5c8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.869s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:49 user nova-compute[75648]: INFO nova.compute.manager [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Terminating instance
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:45:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance rebooted successfully.
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.compute.manager [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-35031cae-11e4-47ac-812f-88726b3f61a0 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.091s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-e157e676-e890-49ab-adf3-3a2edf0809f6 req-d74509e1-d2c6-4b30-96a5-f174b6c82ed3 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e157e676-e890-49ab-adf3-3a2edf0809f6 req-d74509e1-d2c6-4b30-96a5-f174b6c82ed3 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e157e676-e890-49ab-adf3-3a2edf0809f6 req-d74509e1-d2c6-4b30-96a5-f174b6c82ed3 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e157e676-e890-49ab-adf3-3a2edf0809f6 req-d74509e1-d2c6-4b30-96a5-f174b6c82ed3 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-e157e676-e890-49ab-adf3-3a2edf0809f6 req-d74509e1-d2c6-4b30-96a5-f174b6c82ed3 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:49 user nova-compute[75648]: WARNING nova.compute.manager [req-e157e676-e890-49ab-adf3-3a2edf0809f6 req-d74509e1-d2c6-4b30-96a5-f174b6c82ed3 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state active and task_state None.
Nov 15 05:45:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Instance destroyed successfully.
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.objects.instance [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lazy-loading 'resources' on Instance uuid c0d5e58b-f341-43bc-bfd4-e59eec2c1064 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1989909698',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-660236792',id=15,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4TXXCUK1Zw5Q+zcG+nWn0/MlQIY8M6XgKF3HFBzzdeY6r8jDU/9lHGfjHL9z8KJ02ixkcmhgFHolLoWTeOShPOEMMUDtp7GwANshhAI/PTC2qnoHaRFZXIqjm/arwhkw==',key_name='tempest-keypair-2070814856',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e4e0dd038b71424fb24a32f15c6b0abd',ramdisk_id='',reservation_id='r-a81ik3l0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1489834400',owner_user_name='tempest-ServerActionsV293TestJSON-1489834400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bfedcfe15ef443a5a72181d36da14635',uuid=c0d5e58b-f341-43bc-bfd4-e59eec2c1064,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converting VIF {"id": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "address": "fa:16:3e:4e:d6:00", "network": {"id": "7632b7e1-a9ad-418d-bb86-8e7434f7d276", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1254954566-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e4e0dd038b71424fb24a32f15c6b0abd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6cc6ade0-cf", "ovs_interfaceid": "6cc6ade0-cf5d-4caf-b7f8-5df427c874ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG os_vif [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6cc6ade0-cf, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1d32729-aa67-42d2-93ca-d8bf151d289f) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:45:49 user nova-compute[75648]: INFO os_vif [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:d6:00,bridge_name='br-int',has_traffic_filtering=True,id=6cc6ade0-cf5d-4caf-b7f8-5df427c874ce,network=Network(7632b7e1-a9ad-418d-bb86-8e7434f7d276),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6cc6ade0-cf')
Nov 15 05:45:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mySbqVYC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:45:49 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:45:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:45:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d99485-68a1-497f-a69e-d08737ec23f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:45:50 user nova-compute[75648]: No targets found.
Nov 15 05:45:50 user nova-compute[75648]: iSNS:
Nov 15 05:45:50 user nova-compute[75648]: No targets found.
Nov 15 05:45:50 user nova-compute[75648]: STATIC:
Nov 15 05:45:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:45:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059
Nov 15 05:45:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807
Nov 15 05:45:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:45:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:50 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:45:50 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:45:50 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:45:50 user nova-compute[75648]: FIRMWARE:
Nov 15 05:45:50 user nova-compute[75648]: No targets found.
Nov 15 05:45:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:45:50 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:45:50 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bdd7bd-1e7a-492e-b009-5ac95ac87170]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-3799678d-3434-45d4-844a-b11e2c2021be req-32758e50-e4c9-45d3-8541-b4d1d10e654c service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-unplugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3799678d-3434-45d4-844a-b11e2c2021be req-32758e50-e4c9-45d3-8541-b4d1d10e654c service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3799678d-3434-45d4-844a-b11e2c2021be req-32758e50-e4c9-45d3-8541-b4d1d10e654c service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3799678d-3434-45d4-844a-b11e2c2021be req-32758e50-e4c9-45d3-8541-b4d1d10e654c service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-3799678d-3434-45d4-844a-b11e2c2021be req-32758e50-e4c9-45d3-8541-b4d1d10e654c service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-unplugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-3799678d-3434-45d4-844a-b11e2c2021be req-32758e50-e4c9-45d3-8541-b4d1d10e654c service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-unplugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[434d6ed1-1f60-4ca6-a90c-cb5a8dbf47b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:45:50 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:45:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e841d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f75d40-1909-49ee-86f5-b7399acdcff7]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc58563-1b3a-4204-bcf5-716b9b7ce221]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d542786-61f1-41c7-920c-3b8b2d248b72]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[269955c2-4f96-43bb-93aa-23627c4094c4]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0047f604-5282-43cd-b3ab-203268ab9e36]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a173e865-2289-4ddd-a325-ec3eef4e742f]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260]
Nov 15 05:45:50 user nova-compute[75648]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059, portal: 172.16.0.220,3260] successful.
Nov 15 05:45:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:64316407-b9e7-40e7-aa40-16b428a45059 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2b294c-581c-4771-a697-75de8530d988]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.393s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] <== disconnect_volume: return (394ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:45:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Deleting instance files /opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064_del
Nov 15 05:45:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Deletion of /opt/stack/data/nova/instances/c0d5e58b-f341-43bc-bfd4-e59eec2c1064_del complete
Nov 15 05:45:50 user nova-compute[75648]: INFO nova.compute.manager [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 15 05:45:50 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:45:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:51 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:51 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Took 0.79 seconds to deallocate network for instance.
Nov 15 05:45:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] Acquiring lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] No waiting events found dispatching network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:45:52 user nova-compute[75648]: WARNING nova.compute.manager [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received unexpected event network-vif-plugged-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce for instance with vm_state active and task_state deleting.
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-69f8e760-5731-4614-9dc3-46b550c54d98 req-df796c11-d041-40cc-bfa3-c7cc40501574 service nova] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Received event network-vif-deleted-6cc6ade0-cf5d-4caf-b7f8-5df427c874ce {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:45:52 user nova-compute[75648]: INFO nova.compute.manager [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Took 0.90 seconds to detach 1 volumes for instance.
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] [instance: c0d5e58b-f341-43bc-bfd4-e59eec2c1064] Deleting volume: 64316407-b9e7-40e7-aa40-16b428a45059 {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.582s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:52 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Deleted allocations for instance c0d5e58b-f341-43bc-bfd4-e59eec2c1064
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-351b784a-17ef-4c44-9667-fdca3cde17c6 tempest-ServerActionsV293TestJSON-1489834400 tempest-ServerActionsV293TestJSON-1489834400-project-member] Lock "c0d5e58b-f341-43bc-bfd4-e59eec2c1064" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.866s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:45:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:45:57 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:57 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7228MB free_disk=25.032032012939453GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 1c801b45-ec7e-4f10-9443-6ab54528ab70 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 40448f79-0cbc-462a-be88-050f97128a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 108cc4d3-aeab-4419-8cae-d5195cc5b0e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:45:57 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:45:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:45:58 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:45:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:45:58 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:45:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.690s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:45:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:01 user nova-compute[75648]: INFO nova.compute.manager [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Terminating instance
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0aa46ab-9779-4fdd-b3b3-79fd5c9b8a61 req-a5a98972-2baf-4414-8595-ac60228fd9bd service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0aa46ab-9779-4fdd-b3b3-79fd5c9b8a61 req-a5a98972-2baf-4414-8595-ac60228fd9bd service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0aa46ab-9779-4fdd-b3b3-79fd5c9b8a61 req-a5a98972-2baf-4414-8595-ac60228fd9bd service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0aa46ab-9779-4fdd-b3b3-79fd5c9b8a61 req-a5a98972-2baf-4414-8595-ac60228fd9bd service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0aa46ab-9779-4fdd-b3b3-79fd5c9b8a61 req-a5a98972-2baf-4414-8595-ac60228fd9bd service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0aa46ab-9779-4fdd-b3b3-79fd5c9b8a61 req-a5a98972-2baf-4414-8595-ac60228fd9bd service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-unplugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-changed-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Refreshing instance network info cache due to event network-changed-e5dc1ff4-df0c-4836-83e5-95b381eef061. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] Acquiring lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] Acquired lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Refreshing network info cache for port e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:46:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Instance destroyed successfully.
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lazy-loading 'resources' on Instance uuid fec7ed02-51fe-46d6-9d59-e6e21cb56e4c {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1707185365',display_name='tempest-ServerStableDeviceRescueTest-server-1707185365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1707185365',id=6,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFq7aCTB5xjLY8XRjEpsG5GPRei5HEfsSRDUaCLpKUzHWbT09vztqUYj9SGGreBtI+e/RPowDdLYQ0T/VofNNn174OW4JXawjcCPrNhyPxrBGohTsKIelmdMVhsrt0FPmg==',key_name='tempest-keypair-356891063',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='774de78f8d8b498d8b67c7c7d439eb6f',ramdisk_id='',reservation_id='r-tdwwieo1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1094356752',owner_user_name='tempest-ServerStableDeviceRescueTest-1094356752-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='221c346b396e424a8b56b182afbb77d9',uuid=fec7ed02-51fe-46d6-9d59-e6e21cb56e4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converting VIF {"id": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "address": "fa:16:3e:4c:49:4e", "network": {"id": "dd6ddc16-eece-46c8-bb7c-acdadf2e83c8", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2069580535-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "774de78f8d8b498d8b67c7c7d439eb6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc780fe40-bb", "ovs_interfaceid": "c780fe40-bbb3-4c6c-96c8-066f066fe06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG os_vif [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc780fe40-bb, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e45a2a83-f0ea-4df0-986a-f80db20cdd27) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:02 user nova-compute[75648]: INFO os_vif [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:49:4e,bridge_name='br-int',has_traffic_filtering=True,id=c780fe40-bbb3-4c6c-96c8-066f066fe06a,network=Network(dd6ddc16-eece-46c8-bb7c-acdadf2e83c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc780fe40-bb')
Nov 15 05:46:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Deleting instance files /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c_del
Nov 15 05:46:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Deletion of /opt/stack/data/nova/instances/fec7ed02-51fe-46d6-9d59-e6e21cb56e4c_del complete
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "interface-3a095299-f948-48b7-aa05-ca494e9e5ec2-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "interface-3a095299-f948-48b7-aa05-ca494e9e5ec2-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'flavor' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:02 user nova-compute[75648]: INFO nova.compute.manager [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 05:46:02 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:46:02 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updated VIF entry in instance network info cache for port e5dc1ff4-df0c-4836-83e5-95b381eef061. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbf2bab8-c052-4e33-89c5-2a20557a0fcc req-0aea1b17-12c9-4098-801e-75d2cef75791 service nova] Releasing lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'pci_requests' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.objects.base [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Object Instance<3a095299-f948-48b7-aa05-ca494e9e5ec2> lazy-loaded attributes: flavor,pci_requests {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.policy [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '000c6d537a8a4dbc9d7286083c5f6580', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfc975af351c474b82b020077f390c0e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:03 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Took 0.79 seconds to deallocate network for instance.
Nov 15 05:46:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:04 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Deleted allocations for instance fec7ed02-51fe-46d6-9d59-e6e21cb56e4c
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Successfully created port: 03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3a8dd3ed-8463-416b-8182-30e1484e2c69 tempest-ServerStableDeviceRescueTest-1094356752 tempest-ServerStableDeviceRescueTest-1094356752-project-member] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.298s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] Acquiring lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] Lock "fec7ed02-51fe-46d6-9d59-e6e21cb56e4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] No waiting events found dispatching network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:04 user nova-compute[75648]: WARNING nova.compute.manager [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received unexpected event network-vif-plugged-c780fe40-bbb3-4c6c-96c8-066f066fe06a for instance with vm_state deleted and task_state None.
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-ef4ad494-8b52-485d-976f-62d93af95b71 req-5652566c-08fc-423b-9014-828e37036fee service nova] [instance: fec7ed02-51fe-46d6-9d59-e6e21cb56e4c] Received event network-vif-deleted-c780fe40-bbb3-4c6c-96c8-066f066fe06a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Successfully updated port: 03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquired lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-changed-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Refreshing instance network info cache due to event network-changed-03a34e53-9211-402c-91eb-334ff8f88642. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:46:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] Acquiring lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Releasing lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] Acquired lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Refreshing network info cache for port 03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG os_vif [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0298749e-7a54-5466-95e9-74f777250603', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03a34e53-92, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03a34e53-92, col_values=(('qos', UUID('97180f5b-7222-43e6-8449-47c928bc2eba')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03a34e53-92, col_values=(('external_ids', {'iface-id': '03a34e53-9211-402c-91eb-334ff8f88642', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:83:52', 'vm-uuid': '3a095299-f948-48b7-aa05-ca494e9e5ec2'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: INFO os_vif [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92')
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] attach device xml: <interface type="ethernet">
Nov 15 05:46:05 user nova-compute[75648]:   <mac address="fa:16:3e:f5:83:52"/>
Nov 15 05:46:05 user nova-compute[75648]:   <model type="virtio"/>
Nov 15 05:46:05 user nova-compute[75648]:   <mtu size="1442"/>
Nov 15 05:46:05 user nova-compute[75648]:   <target dev="tap03a34e53-92"/>
Nov 15 05:46:05 user nova-compute[75648]: </interface>
Nov 15 05:46:05 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updated VIF entry in instance network info cache for port 03a34e53-9211-402c-91eb-334ff8f88642. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-44e8b5c8-9f34-4b82-b09d-f1959481b1b0 req-1e56517d-2adc-43f2-addd-e413fe90af59 service nova] Releasing lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No BDM found with device name hda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No VIF found with MAC fa:16:3e:dd:95:c0, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:46:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:05 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:05 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:05 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:05</nova:creationTime>
Nov 15 05:46:05 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:05 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:05 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:05 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:05 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:05 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:05 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:05 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:05 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:05 user nova-compute[75648]:     <nova:port uuid="03a34e53-9211-402c-91eb-334ff8f88642">
Nov 15 05:46:05 user nova-compute[75648]:       <nova:ip type="fixed" address="10.10.10.235" ipVersion="4"/>
Nov 15 05:46:05 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:05 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:05 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:05 user nova-compute[75648]:  {{(pid=75648) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4d61b8e9-45fd-4bd0-8950-cda58c697819 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "interface-3a095299-f948-48b7-aa05-ca494e9e5ec2-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.149s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] No waiting events found dispatching network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:06 user nova-compute[75648]: WARNING nova.compute.manager [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received unexpected event network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 for instance with vm_state active and task_state None.
Nov 15 05:46:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] No waiting events found dispatching network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:06 user nova-compute[75648]: WARNING nova.compute.manager [req-fc11cf59-5f64-4b42-8e05-ad702a2f1906 req-1bf85fbd-ff39-47a0-8be6-aac4118deefa service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received unexpected event network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 for instance with vm_state active and task_state None.
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'flavor' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:06 user nova-compute[75648]: INFO nova.compute.manager [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Attaching volume b1ee05a0-2deb-4313-bd50-0ef20cd3676c to /dev/vdb
Nov 15 05:46:06 user nova-compute[75648]: DEBUG os_brick.utils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89dc277d-1777-4c79-9618-bf2a17e090d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e33f33-9b49-4b46-a52b-e4a861642fca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b121183-9a26-44ed-a945-e7dda5447278]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb1e275-5989-4bef-8506-44290e75739e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:46:07 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0951aedb-ba13-42e6-aed8-27dabb04ffa9]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG os_brick.utils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating existing volume attachment record: 744b6a13-83bf-421f-8698-b25283800ca5 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:46:07 user nova-compute[75648]: INFO nova.compute.claims [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Claim successful on node user
Nov 15 05:46:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.394s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:46:07 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:46:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.policy [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '306a53f7ef404302b5d26be66e11562f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '915d7e6dbaaa42bf9100917ef6ce0824', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:46:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Creating image(s)
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk 1073741824" returned: 0 in 0.054s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Successfully created port: c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Cannot resize image /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Ensure instance console log exists: /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Successfully updated port: c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-changed-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Refreshing instance network info cache due to event network-changed-c5e72138-d273-4bb1-ac14-8e5f88e04114. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance network_info: |[{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.neutron [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Refreshing network info cache for port c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start _get_guest_xml network_info=[{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:46:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'pci_devices' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:46:09 user nova-compute[75648]:   <uuid>cad9c255-6774-4949-940a-df74f84d3feb</uuid>
Nov 15 05:46:09 user nova-compute[75648]:   <name>instance-00000019</name>
Nov 15 05:46:09 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:46:09 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:46:09 user nova-compute[75648]:   <metadata>
Nov 15 05:46:09 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:09 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:46:09 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherB-server-2035674182</nova:name>
Nov 15 05:46:09 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:46:09</nova:creationTime>
Nov 15 05:46:09 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:46:09 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:09 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:46:09 user nova-compute[75648]:       <nova:owner>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:user uuid="306a53f7ef404302b5d26be66e11562f">tempest-ServerActionsTestOtherB-1116144874-project-member</nova:user>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:project uuid="915d7e6dbaaa42bf9100917ef6ce0824">tempest-ServerActionsTestOtherB-1116144874</nova:project>
Nov 15 05:46:09 user nova-compute[75648]:       </nova:owner>
Nov 15 05:46:09 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:09 user nova-compute[75648]:       <nova:ports>
Nov 15 05:46:09 user nova-compute[75648]:         <nova:port uuid="c5e72138-d273-4bb1-ac14-8e5f88e04114">
Nov 15 05:46:09 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:46:09 user nova-compute[75648]:         </nova:port>
Nov 15 05:46:09 user nova-compute[75648]:       </nova:ports>
Nov 15 05:46:09 user nova-compute[75648]:     </nova:instance>
Nov 15 05:46:09 user nova-compute[75648]:   </metadata>
Nov 15 05:46:09 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:46:09 user nova-compute[75648]:     <system>
Nov 15 05:46:09 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:46:09 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:46:09 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:46:09 user nova-compute[75648]:       <entry name="serial">cad9c255-6774-4949-940a-df74f84d3feb</entry>
Nov 15 05:46:09 user nova-compute[75648]:       <entry name="uuid">cad9c255-6774-4949-940a-df74f84d3feb</entry>
Nov 15 05:46:09 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:46:09 user nova-compute[75648]:     </system>
Nov 15 05:46:09 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:09 user nova-compute[75648]:   <os>
Nov 15 05:46:09 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:46:09 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:46:09 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:46:09 user nova-compute[75648]:   </os>
Nov 15 05:46:09 user nova-compute[75648]:   <features>
Nov 15 05:46:09 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:09 user nova-compute[75648]:     <apic/>
Nov 15 05:46:09 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:46:09 user nova-compute[75648]:   </features>
Nov 15 05:46:09 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:46:09 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:46:09 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:46:09 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:46:09 user nova-compute[75648]:   </clock>
Nov 15 05:46:09 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:46:09 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:46:09 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:46:09 user nova-compute[75648]:   </cpu>
Nov 15 05:46:09 user nova-compute[75648]:   <devices>
Nov 15 05:46:09 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:46:09 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:46:09 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk"/>
Nov 15 05:46:09 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:46:09 user nova-compute[75648]:     </disk>
Nov 15 05:46:09 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:46:09 user nova-compute[75648]:       <mac address="fa:16:3e:9a:5e:31"/>
Nov 15 05:46:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:46:09 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:46:09 user nova-compute[75648]:       <target dev="tapc5e72138-d2"/>
Nov 15 05:46:09 user nova-compute[75648]:     </interface>
Nov 15 05:46:09 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:46:09 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/console.log" append="off"/>
Nov 15 05:46:09 user nova-compute[75648]:     </serial>
Nov 15 05:46:09 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:46:09 user nova-compute[75648]:     <video>
Nov 15 05:46:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:46:09 user nova-compute[75648]:     </video>
Nov 15 05:46:09 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:46:09 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:46:09 user nova-compute[75648]:     </rng>
Nov 15 05:46:09 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:46:09 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:46:09 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:46:09 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:09 user nova-compute[75648]:   </devices>
Nov 15 05:46:09 user nova-compute[75648]: </domain>
Nov 15 05:46:09 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:46:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG os_vif [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b723c82c-ed01-5f95-b64b-066cc4061458', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e72138-d2, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5e72138-d2, col_values=(('qos', UUID('818b4629-f624-4605-9cc5-ae1155565806')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5e72138-d2, col_values=(('external_ids', {'iface-id': 'c5e72138-d273-4bb1-ac14-8e5f88e04114', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:5e:31', 'vm-uuid': 'cad9c255-6774-4949-940a-df74f84d3feb'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:09 user nova-compute[75648]: INFO os_vif [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2')
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No VIF found with MAC fa:16:3e:9a:5e:31, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:46:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updated VIF entry in instance network info cache for port c5e72138-d273-4bb1-ac14-8e5f88e04114. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:46:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-846b39ec-af13-4445-9610-47c9e85a8b24 req-d62e4391-e92c-42b6-bda6-909332b375f8 service nova] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-e9c21976-7e15-4b12-a56e-1c2157d5efc9 req-636569b9-2342-4406-a0bb-392f191eb566 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e9c21976-7e15-4b12-a56e-1c2157d5efc9 req-636569b9-2342-4406-a0bb-392f191eb566 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e9c21976-7e15-4b12-a56e-1c2157d5efc9 req-636569b9-2342-4406-a0bb-392f191eb566 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e9c21976-7e15-4b12-a56e-1c2157d5efc9 req-636569b9-2342-4406-a0bb-392f191eb566 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-e9c21976-7e15-4b12-a56e-1c2157d5efc9 req-636569b9-2342-4406-a0bb-392f191eb566 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:11 user nova-compute[75648]: WARNING nova.compute.manager [req-e9c21976-7e15-4b12-a56e-1c2157d5efc9 req-636569b9-2342-4406-a0bb-392f191eb566 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state building and task_state spawning.
Nov 15 05:46:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjAcQfru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:46:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:46:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:46:12 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aba4091-a71e-42a9-b2a2-1b22bb0a301b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:46:12 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da38dc7-2a39-4865-a6ac-d1ab4afbb8aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c] added
Nov 15 05:46:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b05c6b-c382-45f1-b304-4e07f076d3ec]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64dd89f-7541-4d83-b0cf-6435668022cf]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjAcQfru {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qjAcQfru" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[de40c972-ec92-4728-a0a6-60ec5d2620df]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qjAcQfru'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a32ac-d1e3-4247-99c2-c815de4dc99c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[499fd665-4cc3-4173-b708-7176ab18de4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16c53e5-ced7-46d2-8a2b-837989d0e49f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260]
Nov 15 05:46:12 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260] successful.
Nov 15 05:46:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18aa9d64-c723-4617-88ac-de169115237f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ca9cf3-aeb6-4357-9f6f-d3b102e95e41]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c (non-flash)
Nov 15 05:46:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:46:12 user nova-compute[75648]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c (non-flash)
Nov 15 05:46:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99940d3-cf3f-4a7a-b31c-91a3c594b5c3]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjAcQfru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23131646462336436', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23131646462336436', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'flavor' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:46:13 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:46:13 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:46:13 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:46:13 user nova-compute[75648]:   <serial>b1ee05a0-2deb-4313-bd50-0ef20cd3676c</serial>
Nov 15 05:46:13 user nova-compute[75648]: </disk>
Nov 15 05:46:13 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:46:13 user nova-compute[75648]: INFO nova.compute.claims [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Claim successful on node user
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:46:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance spawned successfully.
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:13 user nova-compute[75648]: INFO nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Took 5.55 seconds to spawn the instance on the hypervisor.
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-5b0aff0c-a6e9-4ebf-beac-38d0241072e1 req-dd047a91-6c02-4828-aca7-8d9b910d53ec service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5b0aff0c-a6e9-4ebf-beac-38d0241072e1 req-dd047a91-6c02-4828-aca7-8d9b910d53ec service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5b0aff0c-a6e9-4ebf-beac-38d0241072e1 req-dd047a91-6c02-4828-aca7-8d9b910d53ec service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5b0aff0c-a6e9-4ebf-beac-38d0241072e1 req-dd047a91-6c02-4828-aca7-8d9b910d53ec service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-5b0aff0c-a6e9-4ebf-beac-38d0241072e1 req-dd047a91-6c02-4828-aca7-8d9b910d53ec service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:13 user nova-compute[75648]: WARNING nova.compute.manager [req-5b0aff0c-a6e9-4ebf-beac-38d0241072e1 req-dd047a91-6c02-4828-aca7-8d9b910d53ec service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state building and task_state spawning.
Nov 15 05:46:13 user nova-compute[75648]: INFO nova.compute.manager [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Took 6.26 seconds to build instance.
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dc6e84d7-6adb-446e-b8cc-3fbfcbcf58e8 tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.357s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No BDM found with device name hda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] No VIF found with MAC fa:16:3e:dd:95:c0, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f7db0910-e1f8-475f-9e8b-2cbc1be8340d tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.140s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:46:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.policy [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8bd09324c4634b8b820c49b51752a688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a08f06fc4de745b589b4db3c2147e43d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:46:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Creating image(s)
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk 1073741824" returned: 0 in 0.048s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Successfully created port: 7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.217s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Cannot resize image /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Ensure instance console log exists: /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Successfully updated port: 7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing instance network info cache due to event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:15 user nova-compute[75648]: INFO nova.compute.manager [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Detaching volume b1ee05a0-2deb-4313-bd50-0ef20cd3676c
Nov 15 05:46:15 user nova-compute[75648]: INFO nova.virt.block_device [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Attempting to driver detach volume b1ee05a0-2deb-4313-bd50-0ef20cd3676c from mountpoint /dev/vdb
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Attempting to detach device vdb from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:46:15 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:46:15 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:46:15 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:46:15 user nova-compute[75648]:   <serial>b1ee05a0-2deb-4313-bd50-0ef20cd3676c</serial>
Nov 15 05:46:15 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 05:46:15 user nova-compute[75648]: </disk>
Nov 15 05:46:15 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:46:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully detached device vdb from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the persistent domain config.
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:46:15 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:46:15 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:46:15 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:46:15 user nova-compute[75648]:   <serial>b1ee05a0-2deb-4313-bd50-0ef20cd3676c</serial>
Nov 15 05:46:15 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 05:46:15 user nova-compute[75648]: </disk>
Nov 15 05:46:15 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:46:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance network_info: |[{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Start _get_guest_xml network_info=[{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:46:16 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:16 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-927055105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-927055105',id=26,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpdO5eS2Z+vf+8bBm97dhKJcYhTJoR30Qg5PfCQugizmBWklnUSX6K5d26qsw9WzbMdMr5yVpg222SDTag479q5GOTgLDgwAKc4g90Kpv0XhdH/MbODNkNmBj7SONUfbg==',key_name='tempest-keypair-1905129680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-i4r0o8lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=59e7c593-d1f7-4ebf-8fa8-b0ae91c96903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'pci_devices' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:46:16 user nova-compute[75648]:   <uuid>59e7c593-d1f7-4ebf-8fa8-b0ae91c96903</uuid>
Nov 15 05:46:16 user nova-compute[75648]:   <name>instance-0000001a</name>
Nov 15 05:46:16 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:46:16 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:46:16 user nova-compute[75648]:   <metadata>
Nov 15 05:46:16 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:16 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:46:16 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-927055105</nova:name>
Nov 15 05:46:16 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:46:16</nova:creationTime>
Nov 15 05:46:16 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:46:16 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:16 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:46:16 user nova-compute[75648]:       <nova:owner>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:user uuid="8bd09324c4634b8b820c49b51752a688">tempest-AttachVolumeShelveTestJSON-1500760960-project-member</nova:user>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:project uuid="a08f06fc4de745b589b4db3c2147e43d">tempest-AttachVolumeShelveTestJSON-1500760960</nova:project>
Nov 15 05:46:16 user nova-compute[75648]:       </nova:owner>
Nov 15 05:46:16 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:16 user nova-compute[75648]:       <nova:ports>
Nov 15 05:46:16 user nova-compute[75648]:         <nova:port uuid="7d14ba8c-00f2-4218-affc-cf872dda8026">
Nov 15 05:46:16 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:46:16 user nova-compute[75648]:         </nova:port>
Nov 15 05:46:16 user nova-compute[75648]:       </nova:ports>
Nov 15 05:46:16 user nova-compute[75648]:     </nova:instance>
Nov 15 05:46:16 user nova-compute[75648]:   </metadata>
Nov 15 05:46:16 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:46:16 user nova-compute[75648]:     <system>
Nov 15 05:46:16 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:46:16 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:46:16 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:46:16 user nova-compute[75648]:       <entry name="serial">59e7c593-d1f7-4ebf-8fa8-b0ae91c96903</entry>
Nov 15 05:46:16 user nova-compute[75648]:       <entry name="uuid">59e7c593-d1f7-4ebf-8fa8-b0ae91c96903</entry>
Nov 15 05:46:16 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:46:16 user nova-compute[75648]:     </system>
Nov 15 05:46:16 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:16 user nova-compute[75648]:   <os>
Nov 15 05:46:16 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:46:16 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:46:16 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:46:16 user nova-compute[75648]:   </os>
Nov 15 05:46:16 user nova-compute[75648]:   <features>
Nov 15 05:46:16 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:16 user nova-compute[75648]:     <apic/>
Nov 15 05:46:16 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:46:16 user nova-compute[75648]:   </features>
Nov 15 05:46:16 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:46:16 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:46:16 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:46:16 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:46:16 user nova-compute[75648]:   </clock>
Nov 15 05:46:16 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:46:16 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:46:16 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:46:16 user nova-compute[75648]:   </cpu>
Nov 15 05:46:16 user nova-compute[75648]:   <devices>
Nov 15 05:46:16 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:46:16 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:46:16 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk"/>
Nov 15 05:46:16 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:46:16 user nova-compute[75648]:     </disk>
Nov 15 05:46:16 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:46:16 user nova-compute[75648]:       <mac address="fa:16:3e:dc:e3:c7"/>
Nov 15 05:46:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:46:16 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:46:16 user nova-compute[75648]:       <target dev="tap7d14ba8c-00"/>
Nov 15 05:46:16 user nova-compute[75648]:     </interface>
Nov 15 05:46:16 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:46:16 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/console.log" append="off"/>
Nov 15 05:46:16 user nova-compute[75648]:     </serial>
Nov 15 05:46:16 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:46:16 user nova-compute[75648]:     <video>
Nov 15 05:46:16 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:46:16 user nova-compute[75648]:     </video>
Nov 15 05:46:16 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:46:16 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:46:16 user nova-compute[75648]:     </rng>
Nov 15 05:46:16 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:46:16 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:46:16 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:46:16 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:16 user nova-compute[75648]:   </devices>
Nov 15 05:46:16 user nova-compute[75648]: </domain>
Nov 15 05:46:16 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-927055105',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-927055105',id=26,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpdO5eS2Z+vf+8bBm97dhKJcYhTJoR30Qg5PfCQugizmBWklnUSX6K5d26qsw9WzbMdMr5yVpg222SDTag479q5GOTgLDgwAKc4g90Kpv0XhdH/MbODNkNmBj7SONUfbg==',key_name='tempest-keypair-1905129680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-i4r0o8lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:46:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=59e7c593-d1f7-4ebf-8fa8-b0ae91c96903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG os_vif [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2078e822-526b-5fbb-94c3-a7bc5ef56bf9', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d14ba8c-00, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d14ba8c-00, col_values=(('qos', UUID('39fde384-0c3c-4bcd-9adb-96410831e3f3')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d14ba8c-00, col_values=(('external_ids', {'iface-id': '7d14ba8c-00f2-4218-affc-cf872dda8026', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:e3:c7', 'vm-uuid': '59e7c593-d1f7-4ebf-8fa8-b0ae91c96903'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:16 user nova-compute[75648]: INFO os_vif [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00')
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No VIF found with MAC fa:16:3e:dc:e3:c7, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updated VIF entry in instance network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-30fd1efe-1109-44d6-b29b-8b894519481b req-1c73cf69-c642-4d74-86ec-8259d99a2335 service nova] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-6f7ba03f-b833-4bcb-aa5c-2811f88824b9 req-6c2928ec-7e52-4903-9c6c-1eed4039b987 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6f7ba03f-b833-4bcb-aa5c-2811f88824b9 req-6c2928ec-7e52-4903-9c6c-1eed4039b987 service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6f7ba03f-b833-4bcb-aa5c-2811f88824b9 req-6c2928ec-7e52-4903-9c6c-1eed4039b987 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6f7ba03f-b833-4bcb-aa5c-2811f88824b9 req-6c2928ec-7e52-4903-9c6c-1eed4039b987 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-6f7ba03f-b833-4bcb-aa5c-2811f88824b9 req-6c2928ec-7e52-4903-9c6c-1eed4039b987 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:17 user nova-compute[75648]: WARNING nova.compute.manager [req-6f7ba03f-b833-4bcb-aa5c-2811f88824b9 req-6c2928ec-7e52-4903-9c6c-1eed4039b987 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state building and task_state spawning.
Nov 15 05:46:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:46:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance spawned successfully.
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-1920c79c-d2b7-4fd0-99a4-dbe0c85a1268 req-83d63893-df49-429e-bbed-841ca650ad7e service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1920c79c-d2b7-4fd0-99a4-dbe0c85a1268 req-83d63893-df49-429e-bbed-841ca650ad7e service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1920c79c-d2b7-4fd0-99a4-dbe0c85a1268 req-83d63893-df49-429e-bbed-841ca650ad7e service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1920c79c-d2b7-4fd0-99a4-dbe0c85a1268 req-83d63893-df49-429e-bbed-841ca650ad7e service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-1920c79c-d2b7-4fd0-99a4-dbe0c85a1268 req-83d63893-df49-429e-bbed-841ca650ad7e service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:19 user nova-compute[75648]: WARNING nova.compute.manager [req-1920c79c-d2b7-4fd0-99a4-dbe0c85a1268 req-83d63893-df49-429e-bbed-841ca650ad7e service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state building and task_state spawning.
Nov 15 05:46:19 user nova-compute[75648]: INFO nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 15 05:46:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:46:19 user nova-compute[75648]: INFO nova.compute.manager [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Took 6.51 seconds to build instance.
Nov 15 05:46:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8bbbd57c-badc-4c3e-a6d9-45f358a00cff tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.605s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "28e59728-466d-47b7-bdbb-96ce43e78280" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:46:26 user nova-compute[75648]: INFO nova.compute.claims [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Claim successful on node user
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.561s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:46:26 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:46:26 user nova-compute[75648]: DEBUG nova.policy [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '233bc61e55934b57bf40084001640bb3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd80c0c4fdf674d108496b63cd67ac2af', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:46:27 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Creating image(s)
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "/opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "/opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "/opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.260s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.191s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk 1073741824" returned: 0 in 0.068s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Successfully created port: 7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.216s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Cannot resize image /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Ensure instance console log exists: /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Successfully updated port: 7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "refresh_cache-28e59728-466d-47b7-bdbb-96ce43e78280" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquired lock "refresh_cache-28e59728-466d-47b7-bdbb-96ce43e78280" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-changed-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Refreshing instance network info cache due to event network-changed-7cf61aa0-72ae-45b7-bce8-c56e7c967574. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] Acquiring lock "refresh_cache-28e59728-466d-47b7-bdbb-96ce43e78280" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Updating instance_info_cache with network_info: [{"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Releasing lock "refresh_cache-28e59728-466d-47b7-bdbb-96ce43e78280" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Instance network_info: |[{"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] Acquired lock "refresh_cache-28e59728-466d-47b7-bdbb-96ce43e78280" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Refreshing network info cache for port 7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Start _get_guest_xml network_info=[{"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:46:28 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:28 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2122399907',display_name='tempest-VolumesActionsTest-instance-2122399907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2122399907',id=27,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80c0c4fdf674d108496b63cd67ac2af',ramdisk_id='',reservation_id='r-sbr3tskr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1279806277',owner_user_name='tempest-VolumesActionsTest-1279806277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:46:27Z,user_data=None,user_id='233bc61e55934b57bf40084001640bb3',uuid=28e59728-466d-47b7-bdbb-96ce43e78280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converting VIF {"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lazy-loading 'pci_devices' on Instance uuid 28e59728-466d-47b7-bdbb-96ce43e78280 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:46:28 user nova-compute[75648]:   <uuid>28e59728-466d-47b7-bdbb-96ce43e78280</uuid>
Nov 15 05:46:28 user nova-compute[75648]:   <name>instance-0000001b</name>
Nov 15 05:46:28 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:46:28 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:46:28 user nova-compute[75648]:   <metadata>
Nov 15 05:46:28 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:28 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:46:28 user nova-compute[75648]:       <nova:name>tempest-VolumesActionsTest-instance-2122399907</nova:name>
Nov 15 05:46:28 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:46:28</nova:creationTime>
Nov 15 05:46:28 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:46:28 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:28 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:46:28 user nova-compute[75648]:       <nova:owner>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:user uuid="233bc61e55934b57bf40084001640bb3">tempest-VolumesActionsTest-1279806277-project-member</nova:user>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:project uuid="d80c0c4fdf674d108496b63cd67ac2af">tempest-VolumesActionsTest-1279806277</nova:project>
Nov 15 05:46:28 user nova-compute[75648]:       </nova:owner>
Nov 15 05:46:28 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:28 user nova-compute[75648]:       <nova:ports>
Nov 15 05:46:28 user nova-compute[75648]:         <nova:port uuid="7cf61aa0-72ae-45b7-bce8-c56e7c967574">
Nov 15 05:46:28 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:46:28 user nova-compute[75648]:         </nova:port>
Nov 15 05:46:28 user nova-compute[75648]:       </nova:ports>
Nov 15 05:46:28 user nova-compute[75648]:     </nova:instance>
Nov 15 05:46:28 user nova-compute[75648]:   </metadata>
Nov 15 05:46:28 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:46:28 user nova-compute[75648]:     <system>
Nov 15 05:46:28 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:46:28 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:46:28 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:46:28 user nova-compute[75648]:       <entry name="serial">28e59728-466d-47b7-bdbb-96ce43e78280</entry>
Nov 15 05:46:28 user nova-compute[75648]:       <entry name="uuid">28e59728-466d-47b7-bdbb-96ce43e78280</entry>
Nov 15 05:46:28 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:46:28 user nova-compute[75648]:     </system>
Nov 15 05:46:28 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:28 user nova-compute[75648]:   <os>
Nov 15 05:46:28 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:46:28 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:46:28 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:46:28 user nova-compute[75648]:   </os>
Nov 15 05:46:28 user nova-compute[75648]:   <features>
Nov 15 05:46:28 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:28 user nova-compute[75648]:     <apic/>
Nov 15 05:46:28 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:46:28 user nova-compute[75648]:   </features>
Nov 15 05:46:28 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:46:28 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:46:28 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:46:28 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:46:28 user nova-compute[75648]:   </clock>
Nov 15 05:46:28 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:46:28 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:46:28 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:46:28 user nova-compute[75648]:   </cpu>
Nov 15 05:46:28 user nova-compute[75648]:   <devices>
Nov 15 05:46:28 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:46:28 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:46:28 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk"/>
Nov 15 05:46:28 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:46:28 user nova-compute[75648]:     </disk>
Nov 15 05:46:28 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:46:28 user nova-compute[75648]:       <mac address="fa:16:3e:6d:dc:ac"/>
Nov 15 05:46:28 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:46:28 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:46:28 user nova-compute[75648]:       <target dev="tap7cf61aa0-72"/>
Nov 15 05:46:28 user nova-compute[75648]:     </interface>
Nov 15 05:46:28 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:46:28 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/console.log" append="off"/>
Nov 15 05:46:28 user nova-compute[75648]:     </serial>
Nov 15 05:46:28 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:46:28 user nova-compute[75648]:     <video>
Nov 15 05:46:28 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:46:28 user nova-compute[75648]:     </video>
Nov 15 05:46:28 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:46:28 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:46:28 user nova-compute[75648]:     </rng>
Nov 15 05:46:28 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:46:28 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:46:28 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:46:28 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:28 user nova-compute[75648]:   </devices>
Nov 15 05:46:28 user nova-compute[75648]: </domain>
Nov 15 05:46:28 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2122399907',display_name='tempest-VolumesActionsTest-instance-2122399907',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2122399907',id=27,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d80c0c4fdf674d108496b63cd67ac2af',ramdisk_id='',reservation_id='r-sbr3tskr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1279806277',owner_user_name='tempest-VolumesActionsTest-1279806277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:46:27Z,user_data=None,user_id='233bc61e55934b57bf40084001640bb3',uuid=28e59728-466d-47b7-bdbb-96ce43e78280,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converting VIF {"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG os_vif [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd20e7af2-f1af-5b5a-9ef8-c0e497ab1fb7', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cf61aa0-72, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cf61aa0-72, col_values=(('qos', UUID('558a22b7-3e4e-4498-96ef-56aaff1b5bba')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cf61aa0-72, col_values=(('external_ids', {'iface-id': '7cf61aa0-72ae-45b7-bce8-c56e7c967574', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6d:dc:ac', 'vm-uuid': '28e59728-466d-47b7-bdbb-96ce43e78280'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:28 user nova-compute[75648]: INFO os_vif [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72')
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] No VIF found with MAC fa:16:3e:6d:dc:ac, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Updated VIF entry in instance network info cache for port 7cf61aa0-72ae-45b7-bce8-c56e7c967574. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Updating instance_info_cache with network_info: [{"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-974b9a97-65a6-41a0-97ea-b341718c1625 req-395d99fd-f7ab-4fa9-a9d1-dfebcede2545 service nova] Releasing lock "refresh_cache-28e59728-466d-47b7-bdbb-96ce43e78280" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-b96863ed-bd55-42c7-9d62-393db13ca2fe req-88af6049-9b3a-439b-8fc1-9705ff2b7594 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b96863ed-bd55-42c7-9d62-393db13ca2fe req-88af6049-9b3a-439b-8fc1-9705ff2b7594 service nova] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b96863ed-bd55-42c7-9d62-393db13ca2fe req-88af6049-9b3a-439b-8fc1-9705ff2b7594 service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b96863ed-bd55-42c7-9d62-393db13ca2fe req-88af6049-9b3a-439b-8fc1-9705ff2b7594 service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-b96863ed-bd55-42c7-9d62-393db13ca2fe req-88af6049-9b3a-439b-8fc1-9705ff2b7594 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] No waiting events found dispatching network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:30 user nova-compute[75648]: WARNING nova.compute.manager [req-b96863ed-bd55-42c7-9d62-393db13ca2fe req-88af6049-9b3a-439b-8fc1-9705ff2b7594 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received unexpected event network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 for instance with vm_state building and task_state spawning.
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:46:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Instance spawned successfully.
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-88914140-8694-4ba6-ac3b-bf8fa1cef1a5 req-2b59436d-5ad0-4b3e-a0f3-8a6291762fa8 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-88914140-8694-4ba6-ac3b-bf8fa1cef1a5 req-2b59436d-5ad0-4b3e-a0f3-8a6291762fa8 service nova] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-88914140-8694-4ba6-ac3b-bf8fa1cef1a5 req-2b59436d-5ad0-4b3e-a0f3-8a6291762fa8 service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-88914140-8694-4ba6-ac3b-bf8fa1cef1a5 req-2b59436d-5ad0-4b3e-a0f3-8a6291762fa8 service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-88914140-8694-4ba6-ac3b-bf8fa1cef1a5 req-2b59436d-5ad0-4b3e-a0f3-8a6291762fa8 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] No waiting events found dispatching network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:32 user nova-compute[75648]: WARNING nova.compute.manager [req-88914140-8694-4ba6-ac3b-bf8fa1cef1a5 req-2b59436d-5ad0-4b3e-a0f3-8a6291762fa8 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received unexpected event network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 for instance with vm_state building and task_state spawning.
Nov 15 05:46:32 user nova-compute[75648]: INFO nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Took 5.42 seconds to spawn the instance on the hypervisor.
Nov 15 05:46:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:46:32 user nova-compute[75648]: INFO nova.compute.manager [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Took 6.37 seconds to build instance.
Nov 15 05:46:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ca31b66e-8b8c-4444-b6de-779065f35ee7 tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "28e59728-466d-47b7-bdbb-96ce43e78280" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.491s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:36 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 is timed out.
Nov 15 05:46:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully detached device vdb from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the live domain config.
Nov 15 05:46:36 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:46:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qjAcQfru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:46:36 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:46:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:46:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:46:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[efde669f-1322-40ba-bf12-dfcb806ca05a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:46:36 user nova-compute[75648]: No targets found.
Nov 15 05:46:36 user nova-compute[75648]: iSNS:
Nov 15 05:46:36 user nova-compute[75648]: No targets found.
Nov 15 05:46:36 user nova-compute[75648]: STATIC:
Nov 15 05:46:36 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c
Nov 15 05:46:36 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:46:36 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:46:36 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:46:36 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:46:36 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:46:36 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807
Nov 15 05:46:36 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:46:36 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:46:36 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:46:36 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:46:36 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:46:36 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:46:36 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:46:36 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:46:36 user nova-compute[75648]: FIRMWARE:
Nov 15 05:46:36 user nova-compute[75648]: No targets found.
Nov 15 05:46:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:46:37 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:46:37 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31ebca7-7ca7-4c97-9989-c5031f143132]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[da92afbc-44f8-4e6a-ae8d-fdd450709ff2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c (non-flash)
Nov 15 05:46:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:46:37 user nova-compute[75648]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c (non-flash)
Nov 15 05:46:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8589480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df923bb-af25-49fb-b687-50463b6f0b73]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[38427386-2c4c-4fd1-995f-301db6c45a66]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0da4ee-c409-4dba-a3a1-892a1e0390f4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2bf9b5-f95e-4fb5-8be0-0f91c119a326]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dde373a-6ebb-48f0-8d73-2223a2609fcb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7511bf-cfc0-48aa-b8da-700522a4613c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260]
Nov 15 05:46:37 user nova-compute[75648]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c, portal: 172.16.0.220,3260] successful.
Nov 15 05:46:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1ee05a0-2deb-4313-bd50-0ef20cd3676c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3309e0-04b2-4549-a349-a34a015a805c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] <== disconnect_volume: return (319ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:46:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'flavor' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8553853f-629c-4646-84af-d558e0fab756 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.374s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "interface-3a095299-f948-48b7-aa05-ca494e9e5ec2-03a34e53-9211-402c-91eb-334ff8f88642" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "interface-3a095299-f948-48b7-aa05-ca494e9e5ec2-03a34e53-9211-402c-91eb-334ff8f88642" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'flavor' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface> {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface> {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Attempting to detach device tap03a34e53-92 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] detach device xml: <interface type="ethernet">
Nov 15 05:46:38 user nova-compute[75648]:   <mac address="fa:16:3e:f5:83:52"/>
Nov 15 05:46:38 user nova-compute[75648]:   <model type="virtio"/>
Nov 15 05:46:38 user nova-compute[75648]:   <mtu size="1442"/>
Nov 15 05:46:38 user nova-compute[75648]:   <target dev="tap03a34e53-92"/>
Nov 15 05:46:38 user nova-compute[75648]: </interface>
Nov 15 05:46:38 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface> {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface>not found in domain: <domain type='kvm' id='26'>
Nov 15 05:46:38 user nova-compute[75648]:   <name>instance-00000016</name>
Nov 15 05:46:38 user nova-compute[75648]:   <uuid>3a095299-f948-48b7-aa05-ca494e9e5ec2</uuid>
Nov 15 05:46:38 user nova-compute[75648]:   <metadata>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:38 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:38 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:38 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:05</nova:creationTime>
Nov 15 05:46:38 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:38 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:38 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:38 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:38 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:38 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:38 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:38 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:38 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:38 user nova-compute[75648]:     <nova:port uuid="03a34e53-9211-402c-91eb-334ff8f88642">
Nov 15 05:46:38 user nova-compute[75648]:       <nova:ip type="fixed" address="10.10.10.235" ipVersion="4"/>
Nov 15 05:46:38 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:38 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:38 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:38 user nova-compute[75648]:   </metadata>
Nov 15 05:46:38 user nova-compute[75648]:   <memory unit='KiB'>524288</memory>
Nov 15 05:46:38 user nova-compute[75648]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 05:46:38 user nova-compute[75648]:   <vcpu placement='static'>1</vcpu>
Nov 15 05:46:38 user nova-compute[75648]:   <resource>
Nov 15 05:46:38 user nova-compute[75648]:     <partition>/machine</partition>
Nov 15 05:46:38 user nova-compute[75648]:   </resource>
Nov 15 05:46:38 user nova-compute[75648]:   <sysinfo type='smbios'>
Nov 15 05:46:38 user nova-compute[75648]:     <system>
Nov 15 05:46:38 user nova-compute[75648]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 05:46:38 user nova-compute[75648]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 05:46:38 user nova-compute[75648]:       <entry name='version'>0.0.0</entry>
Nov 15 05:46:38 user nova-compute[75648]:       <entry name='serial'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:38 user nova-compute[75648]:       <entry name='uuid'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:38 user nova-compute[75648]:       <entry name='family'>Virtual Machine</entry>
Nov 15 05:46:38 user nova-compute[75648]:     </system>
Nov 15 05:46:38 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:38 user nova-compute[75648]:   <os>
Nov 15 05:46:38 user nova-compute[75648]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 05:46:38 user nova-compute[75648]:     <boot dev='hd'/>
Nov 15 05:46:38 user nova-compute[75648]:     <smbios mode='sysinfo'/>
Nov 15 05:46:38 user nova-compute[75648]:   </os>
Nov 15 05:46:38 user nova-compute[75648]:   <features>
Nov 15 05:46:38 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:38 user nova-compute[75648]:     <apic/>
Nov 15 05:46:38 user nova-compute[75648]:     <vmcoreinfo state='on'/>
Nov 15 05:46:38 user nova-compute[75648]:   </features>
Nov 15 05:46:38 user nova-compute[75648]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 05:46:38 user nova-compute[75648]:     <model fallback='forbid'>Nehalem</model>
Nov 15 05:46:38 user nova-compute[75648]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 05:46:38 user nova-compute[75648]:     <feature policy='require' name='vme'/>
Nov 15 05:46:38 user nova-compute[75648]:     <feature policy='require' name='x2apic'/>
Nov 15 05:46:38 user nova-compute[75648]:     <feature policy='require' name='hypervisor'/>
Nov 15 05:46:38 user nova-compute[75648]:   </cpu>
Nov 15 05:46:38 user nova-compute[75648]:   <clock offset='utc'>
Nov 15 05:46:38 user nova-compute[75648]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 05:46:38 user nova-compute[75648]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 05:46:38 user nova-compute[75648]:     <timer name='hpet' present='no'/>
Nov 15 05:46:38 user nova-compute[75648]:   </clock>
Nov 15 05:46:38 user nova-compute[75648]:   <on_poweroff>destroy</on_poweroff>
Nov 15 05:46:38 user nova-compute[75648]:   <on_reboot>restart</on_reboot>
Nov 15 05:46:38 user nova-compute[75648]:   <on_crash>destroy</on_crash>
Nov 15 05:46:38 user nova-compute[75648]:   <devices>
Nov 15 05:46:38 user nova-compute[75648]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 05:46:38 user nova-compute[75648]:     <disk type='file' device='disk'>
Nov 15 05:46:38 user nova-compute[75648]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 05:46:38 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk' index='2'/>
Nov 15 05:46:38 user nova-compute[75648]:       <backingStore type='file' index='3'>
Nov 15 05:46:38 user nova-compute[75648]:         <format type='raw'/>
Nov 15 05:46:38 user nova-compute[75648]:         <source file='/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a'/>
Nov 15 05:46:38 user nova-compute[75648]:         <backingStore/>
Nov 15 05:46:38 user nova-compute[75648]:       </backingStore>
Nov 15 05:46:38 user nova-compute[75648]:       <target dev='vda' bus='virtio'/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='virtio-disk0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </disk>
Nov 15 05:46:38 user nova-compute[75648]:     <disk type='file' device='cdrom'>
Nov 15 05:46:38 user nova-compute[75648]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 05:46:38 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config' index='1'/>
Nov 15 05:46:38 user nova-compute[75648]:       <backingStore/>
Nov 15 05:46:38 user nova-compute[75648]:       <target dev='hda' bus='ide'/>
Nov 15 05:46:38 user nova-compute[75648]:       <readonly/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='ide0-0-0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </disk>
Nov 15 05:46:38 user nova-compute[75648]:     <controller type='usb' index='0' model='none'>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='usb'/>
Nov 15 05:46:38 user nova-compute[75648]:     </controller>
Nov 15 05:46:38 user nova-compute[75648]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='pci.0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </controller>
Nov 15 05:46:38 user nova-compute[75648]:     <controller type='ide' index='0'>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='ide'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 05:46:38 user nova-compute[75648]:     </controller>
Nov 15 05:46:38 user nova-compute[75648]:     <interface type='ethernet'>
Nov 15 05:46:38 user nova-compute[75648]:       <mac address='fa:16:3e:dd:95:c0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <target dev='tape5dc1ff4-df'/>
Nov 15 05:46:38 user nova-compute[75648]:       <model type='virtio'/>
Nov 15 05:46:38 user nova-compute[75648]:       <mtu size='1442'/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='net0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </interface>
Nov 15 05:46:38 user nova-compute[75648]:     <interface type='ethernet'>
Nov 15 05:46:38 user nova-compute[75648]:       <mac address='fa:16:3e:f5:83:52'/>
Nov 15 05:46:38 user nova-compute[75648]:       <target dev='tap03a34e53-92'/>
Nov 15 05:46:38 user nova-compute[75648]:       <model type='virtio'/>
Nov 15 05:46:38 user nova-compute[75648]:       <mtu size='1442'/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='net1'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </interface>
Nov 15 05:46:38 user nova-compute[75648]:     <serial type='pty'>
Nov 15 05:46:38 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:38 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:38 user nova-compute[75648]:       <target type='isa-serial' port='0'>
Nov 15 05:46:38 user nova-compute[75648]:         <model name='isa-serial'/>
Nov 15 05:46:38 user nova-compute[75648]:       </target>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </serial>
Nov 15 05:46:38 user nova-compute[75648]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 05:46:38 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:38 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:38 user nova-compute[75648]:       <target type='serial' port='0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </console>
Nov 15 05:46:38 user nova-compute[75648]:     <input type='mouse' bus='ps2'>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='input0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </input>
Nov 15 05:46:38 user nova-compute[75648]:     <input type='keyboard' bus='ps2'>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='input1'/>
Nov 15 05:46:38 user nova-compute[75648]:     </input>
Nov 15 05:46:38 user nova-compute[75648]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 05:46:38 user nova-compute[75648]:       <listen type='address' address='0.0.0.0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </graphics>
Nov 15 05:46:38 user nova-compute[75648]:     <audio id='1' type='none'/>
Nov 15 05:46:38 user nova-compute[75648]:     <video>
Nov 15 05:46:38 user nova-compute[75648]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='video0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </video>
Nov 15 05:46:38 user nova-compute[75648]:     <memballoon model='virtio'>
Nov 15 05:46:38 user nova-compute[75648]:       <stats period='10'/>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='balloon0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:38 user nova-compute[75648]:     <rng model='virtio'>
Nov 15 05:46:38 user nova-compute[75648]:       <backend model='random'>/dev/urandom</backend>
Nov 15 05:46:38 user nova-compute[75648]:       <alias name='rng0'/>
Nov 15 05:46:38 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 05:46:38 user nova-compute[75648]:     </rng>
Nov 15 05:46:38 user nova-compute[75648]:   </devices>
Nov 15 05:46:38 user nova-compute[75648]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 05:46:38 user nova-compute[75648]:     <label>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</label>
Nov 15 05:46:38 user nova-compute[75648]:     <imagelabel>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</imagelabel>
Nov 15 05:46:38 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:38 user nova-compute[75648]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 05:46:38 user nova-compute[75648]:     <label>+64055:+108</label>
Nov 15 05:46:38 user nova-compute[75648]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 05:46:38 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:38 user nova-compute[75648]: </domain>
Nov 15 05:46:38 user nova-compute[75648]:  {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 05:46:38 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully detached device tap03a34e53-92 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the persistent domain config.
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] (1/8): Attempting to detach device tap03a34e53-92 with device alias net1 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] detach device xml: <interface type="ethernet">
Nov 15 05:46:38 user nova-compute[75648]:   <mac address="fa:16:3e:f5:83:52"/>
Nov 15 05:46:38 user nova-compute[75648]:   <model type="virtio"/>
Nov 15 05:46:38 user nova-compute[75648]:   <mtu size="1442"/>
Nov 15 05:46:38 user nova-compute[75648]:   <target dev="tap03a34e53-92"/>
Nov 15 05:46:38 user nova-compute[75648]: </interface>
Nov 15 05:46:38 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Start waiting for the detach event from libvirt for device tap03a34e53-92 with device alias net1 for instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:46:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:39 user nova-compute[75648]: DEBUG nova.compute.manager [req-0f872db6-39a1-44b2-8772-df93bf104d1b req-415fc10c-cba4-4eb0-bab4-8c8963e6cf41 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-unplugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0f872db6-39a1-44b2-8772-df93bf104d1b req-415fc10c-cba4-4eb0-bab4-8c8963e6cf41 service nova] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0f872db6-39a1-44b2-8772-df93bf104d1b req-415fc10c-cba4-4eb0-bab4-8c8963e6cf41 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0f872db6-39a1-44b2-8772-df93bf104d1b req-415fc10c-cba4-4eb0-bab4-8c8963e6cf41 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:39 user nova-compute[75648]: DEBUG nova.compute.manager [req-0f872db6-39a1-44b2-8772-df93bf104d1b req-415fc10c-cba4-4eb0-bab4-8c8963e6cf41 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] No waiting events found dispatching network-vif-unplugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:39 user nova-compute[75648]: WARNING nova.compute.manager [req-0f872db6-39a1-44b2-8772-df93bf104d1b req-415fc10c-cba4-4eb0-bab4-8c8963e6cf41 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received unexpected event network-vif-unplugged-03a34e53-9211-402c-91eb-334ff8f88642 for instance with vm_state active and task_state None.
Nov 15 05:46:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-0c96f50c-3f47-476c-9f13-cd7b3aa3cbf6 req-d5de9c31-d7de-4916-bb36-a148e40406e7 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c96f50c-3f47-476c-9f13-cd7b3aa3cbf6 req-d5de9c31-d7de-4916-bb36-a148e40406e7 service nova] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c96f50c-3f47-476c-9f13-cd7b3aa3cbf6 req-d5de9c31-d7de-4916-bb36-a148e40406e7 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c96f50c-3f47-476c-9f13-cd7b3aa3cbf6 req-d5de9c31-d7de-4916-bb36-a148e40406e7 service nova] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-0c96f50c-3f47-476c-9f13-cd7b3aa3cbf6 req-d5de9c31-d7de-4916-bb36-a148e40406e7 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] No waiting events found dispatching network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:41 user nova-compute[75648]: WARNING nova.compute.manager [req-0c96f50c-3f47-476c-9f13-cd7b3aa3cbf6 req-d5de9c31-d7de-4916-bb36-a148e40406e7 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received unexpected event network-vif-plugged-03a34e53-9211-402c-91eb-334ff8f88642 for instance with vm_state active and task_state None.
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:41 user nova-compute[75648]: INFO nova.compute.manager [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Terminating instance
Nov 15 05:46:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Instance destroyed successfully.
Nov 15 05:46:42 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lazy-loading 'resources' on Instance uuid 1c801b45-ec7e-4f10-9443-6ab54528ab70 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:39:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1758105222',display_name='tempest-TestStampPattern-server-1758105222',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1758105222',id=11,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAoS16Y3HpfD0rY8HR4haBL7SzdPRoe0noXJF12ixXptNi3aAgE2AkkZArlpCa0FKKxvIhR6Hm0dXnO+kB90zMOmyhlZh1WRdqxONLK1loWH9Oj0yK5VWXCMdaCm6WMDVQ==',key_name='tempest-TestStampPattern-833870012',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='79b50966fa1c4fd78b0a555cb3afffee',ramdisk_id='',reservation_id='r-xtymi1dz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-591482588',owner_user_name='tempest-TestStampPattern-591482588-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:42:49Z,user_data=None,user_id='4ae7fdd74e664596ab1a323e9c9347a5',uuid=1c801b45-ec7e-4f10-9443-6ab54528ab70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converting VIF {"id": "dbb125a4-be50-4777-baec-60fe0ec9e534", "address": "fa:16:3e:36:c5:e6", "network": {"id": "b3733466-6be5-4950-9076-3bbd6a6e3f69", "bridge": "br-int", "label": "tempest-TestStampPattern-1356740952-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "79b50966fa1c4fd78b0a555cb3afffee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbb125a4-be", "ovs_interfaceid": "dbb125a4-be50-4777-baec-60fe0ec9e534", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG os_vif [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbb125a4-be, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6342d1e-3f1e-4a63-a879-8153e627d3be) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:42 user nova-compute[75648]: INFO os_vif [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:c5:e6,bridge_name='br-int',has_traffic_filtering=True,id=dbb125a4-be50-4777-baec-60fe0ec9e534,network=Network(b3733466-6be5-4950-9076-3bbd6a6e3f69),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbb125a4-be')
Nov 15 05:46:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Deleting instance files /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70_del
Nov 15 05:46:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Deletion of /opt/stack/data/nova/instances/1c801b45-ec7e-4f10-9443-6ab54528ab70_del complete
Nov 15 05:46:42 user nova-compute[75648]: INFO nova.compute.manager [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 15 05:46:42 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:46:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-changed-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Refreshing instance network info cache due to event network-changed-dbb125a4-be50-4777-baec-60fe0ec9e534. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Acquiring lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Acquired lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Refreshing network info cache for port dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:43 user nova-compute[75648]: INFO nova.network.neutron [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Port dbb125a4-be50-4777-baec-60fe0ec9e534 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:43 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Took 0.52 seconds to deallocate network for instance.
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Releasing lock "refresh_cache-1c801b45-ec7e-4f10-9443-6ab54528ab70" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-vif-unplugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] No waiting events found dispatching network-vif-unplugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-vif-unplugged-dbb125a4-be50-4777-baec-60fe0ec9e534 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Acquiring lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] No waiting events found dispatching network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:46:43 user nova-compute[75648]: WARNING nova.compute.manager [req-1d9cdbb1-bf8e-43ca-b752-121df64af4c8 req-c64e973a-b114-4ab4-b1ca-d3c44894cac7 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received unexpected event network-vif-plugged-dbb125a4-be50-4777-baec-60fe0ec9e534 for instance with vm_state active and task_state deleting.
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-f2b3555e-a948-4644-8668-b16dd5b474ad req-4b10586e-e164-4c6e-80d6-438a3b026ef8 service nova] [instance: 1c801b45-ec7e-4f10-9443-6ab54528ab70] Received event network-vif-deleted-dbb125a4-be50-4777-baec-60fe0ec9e534 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:43 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Deleted allocations for instance 1c801b45-ec7e-4f10-9443-6ab54528ab70
Nov 15 05:46:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a3eb0efc-9b63-4062-bc37-14c8ede87d94 tempest-TestStampPattern-591482588 tempest-TestStampPattern-591482588-project-member] Lock "1c801b45-ec7e-4f10-9443-6ab54528ab70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.347s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:46:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Waiting for libvirt event about the detach of device tap03a34e53-92 with device alias net1 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 is timed out.
Nov 15 05:46:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface> {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface>not found in domain: <domain type='kvm' id='26'>
Nov 15 05:46:58 user nova-compute[75648]:   <name>instance-00000016</name>
Nov 15 05:46:58 user nova-compute[75648]:   <uuid>3a095299-f948-48b7-aa05-ca494e9e5ec2</uuid>
Nov 15 05:46:58 user nova-compute[75648]:   <metadata>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:58 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:58 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:58 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:05</nova:creationTime>
Nov 15 05:46:58 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:58 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:58 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:58 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:58 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:58 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:58 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:58 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:58 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:58 user nova-compute[75648]:     <nova:port uuid="03a34e53-9211-402c-91eb-334ff8f88642">
Nov 15 05:46:58 user nova-compute[75648]:       <nova:ip type="fixed" address="10.10.10.235" ipVersion="4"/>
Nov 15 05:46:58 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:58 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:58 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:58 user nova-compute[75648]:   </metadata>
Nov 15 05:46:58 user nova-compute[75648]:   <memory unit='KiB'>524288</memory>
Nov 15 05:46:58 user nova-compute[75648]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 05:46:58 user nova-compute[75648]:   <vcpu placement='static'>1</vcpu>
Nov 15 05:46:58 user nova-compute[75648]:   <resource>
Nov 15 05:46:58 user nova-compute[75648]:     <partition>/machine</partition>
Nov 15 05:46:58 user nova-compute[75648]:   </resource>
Nov 15 05:46:58 user nova-compute[75648]:   <sysinfo type='smbios'>
Nov 15 05:46:58 user nova-compute[75648]:     <system>
Nov 15 05:46:58 user nova-compute[75648]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 05:46:58 user nova-compute[75648]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 05:46:58 user nova-compute[75648]:       <entry name='version'>0.0.0</entry>
Nov 15 05:46:58 user nova-compute[75648]:       <entry name='serial'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:58 user nova-compute[75648]:       <entry name='uuid'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:58 user nova-compute[75648]:       <entry name='family'>Virtual Machine</entry>
Nov 15 05:46:58 user nova-compute[75648]:     </system>
Nov 15 05:46:58 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:58 user nova-compute[75648]:   <os>
Nov 15 05:46:58 user nova-compute[75648]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 05:46:58 user nova-compute[75648]:     <boot dev='hd'/>
Nov 15 05:46:58 user nova-compute[75648]:     <smbios mode='sysinfo'/>
Nov 15 05:46:58 user nova-compute[75648]:   </os>
Nov 15 05:46:58 user nova-compute[75648]:   <features>
Nov 15 05:46:58 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:58 user nova-compute[75648]:     <apic/>
Nov 15 05:46:58 user nova-compute[75648]:     <vmcoreinfo state='on'/>
Nov 15 05:46:58 user nova-compute[75648]:   </features>
Nov 15 05:46:58 user nova-compute[75648]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 05:46:58 user nova-compute[75648]:     <model fallback='forbid'>Nehalem</model>
Nov 15 05:46:58 user nova-compute[75648]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 05:46:58 user nova-compute[75648]:     <feature policy='require' name='vme'/>
Nov 15 05:46:58 user nova-compute[75648]:     <feature policy='require' name='x2apic'/>
Nov 15 05:46:58 user nova-compute[75648]:     <feature policy='require' name='hypervisor'/>
Nov 15 05:46:58 user nova-compute[75648]:   </cpu>
Nov 15 05:46:58 user nova-compute[75648]:   <clock offset='utc'>
Nov 15 05:46:58 user nova-compute[75648]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 05:46:58 user nova-compute[75648]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 05:46:58 user nova-compute[75648]:     <timer name='hpet' present='no'/>
Nov 15 05:46:58 user nova-compute[75648]:   </clock>
Nov 15 05:46:58 user nova-compute[75648]:   <on_poweroff>destroy</on_poweroff>
Nov 15 05:46:58 user nova-compute[75648]:   <on_reboot>restart</on_reboot>
Nov 15 05:46:58 user nova-compute[75648]:   <on_crash>destroy</on_crash>
Nov 15 05:46:58 user nova-compute[75648]:   <devices>
Nov 15 05:46:58 user nova-compute[75648]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 05:46:58 user nova-compute[75648]:     <disk type='file' device='disk'>
Nov 15 05:46:58 user nova-compute[75648]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 05:46:58 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk' index='2'/>
Nov 15 05:46:58 user nova-compute[75648]:       <backingStore type='file' index='3'>
Nov 15 05:46:58 user nova-compute[75648]:         <format type='raw'/>
Nov 15 05:46:58 user nova-compute[75648]:         <source file='/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a'/>
Nov 15 05:46:58 user nova-compute[75648]:         <backingStore/>
Nov 15 05:46:58 user nova-compute[75648]:       </backingStore>
Nov 15 05:46:58 user nova-compute[75648]:       <target dev='vda' bus='virtio'/>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='virtio-disk0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </disk>
Nov 15 05:46:58 user nova-compute[75648]:     <disk type='file' device='cdrom'>
Nov 15 05:46:58 user nova-compute[75648]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 05:46:58 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config' index='1'/>
Nov 15 05:46:58 user nova-compute[75648]:       <backingStore/>
Nov 15 05:46:58 user nova-compute[75648]:       <target dev='hda' bus='ide'/>
Nov 15 05:46:58 user nova-compute[75648]:       <readonly/>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='ide0-0-0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </disk>
Nov 15 05:46:58 user nova-compute[75648]:     <controller type='usb' index='0' model='none'>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='usb'/>
Nov 15 05:46:58 user nova-compute[75648]:     </controller>
Nov 15 05:46:58 user nova-compute[75648]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='pci.0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </controller>
Nov 15 05:46:58 user nova-compute[75648]:     <controller type='ide' index='0'>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='ide'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 05:46:58 user nova-compute[75648]:     </controller>
Nov 15 05:46:58 user nova-compute[75648]:     <interface type='ethernet'>
Nov 15 05:46:58 user nova-compute[75648]:       <mac address='fa:16:3e:dd:95:c0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <target dev='tape5dc1ff4-df'/>
Nov 15 05:46:58 user nova-compute[75648]:       <model type='virtio'/>
Nov 15 05:46:58 user nova-compute[75648]:       <mtu size='1442'/>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='net0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </interface>
Nov 15 05:46:58 user nova-compute[75648]:     <serial type='pty'>
Nov 15 05:46:58 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:58 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:58 user nova-compute[75648]:       <target type='isa-serial' port='0'>
Nov 15 05:46:58 user nova-compute[75648]:         <model name='isa-serial'/>
Nov 15 05:46:58 user nova-compute[75648]:       </target>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </serial>
Nov 15 05:46:58 user nova-compute[75648]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 05:46:58 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:58 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:58 user nova-compute[75648]:       <target type='serial' port='0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </console>
Nov 15 05:46:58 user nova-compute[75648]:     <input type='mouse' bus='ps2'>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='input0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </input>
Nov 15 05:46:58 user nova-compute[75648]:     <input type='keyboard' bus='ps2'>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='input1'/>
Nov 15 05:46:58 user nova-compute[75648]:     </input>
Nov 15 05:46:58 user nova-compute[75648]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 05:46:58 user nova-compute[75648]:       <listen type='address' address='0.0.0.0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </graphics>
Nov 15 05:46:58 user nova-compute[75648]:     <audio id='1' type='none'/>
Nov 15 05:46:58 user nova-compute[75648]:     <video>
Nov 15 05:46:58 user nova-compute[75648]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='video0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </video>
Nov 15 05:46:58 user nova-compute[75648]:     <memballoon model='virtio'>
Nov 15 05:46:58 user nova-compute[75648]:       <stats period='10'/>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='balloon0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:58 user nova-compute[75648]:     <rng model='virtio'>
Nov 15 05:46:58 user nova-compute[75648]:       <backend model='random'>/dev/urandom</backend>
Nov 15 05:46:58 user nova-compute[75648]:       <alias name='rng0'/>
Nov 15 05:46:58 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 05:46:58 user nova-compute[75648]:     </rng>
Nov 15 05:46:58 user nova-compute[75648]:   </devices>
Nov 15 05:46:58 user nova-compute[75648]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 05:46:58 user nova-compute[75648]:     <label>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</label>
Nov 15 05:46:58 user nova-compute[75648]:     <imagelabel>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</imagelabel>
Nov 15 05:46:58 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:58 user nova-compute[75648]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 05:46:58 user nova-compute[75648]:     <label>+64055:+108</label>
Nov 15 05:46:58 user nova-compute[75648]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 05:46:58 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:58 user nova-compute[75648]: </domain>
Nov 15 05:46:58 user nova-compute[75648]:  {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 05:46:58 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully detached device tap03a34e53-92 from instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 from the live domain config.
Nov 15 05:46:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:58 user nova-compute[75648]: DEBUG os_vif [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:46:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:58 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7062MB free_disk=25.184741973876953GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03a34e53-92, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97180f5b-7222-43e6-8449-47c928bc2eba) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:46:59 user nova-compute[75648]: INFO os_vif [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92')
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:59 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:59</nova:creationTime>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:59 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:59 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:59 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:59 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:59 user nova-compute[75648]:  {{(pid=75648) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 40448f79-0cbc-462a-be88-050f97128a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 108cc4d3-aeab-4419-8cae-d5195cc5b0e8 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 28e59728-466d-47b7-bdbb-96ce43e78280 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.627s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquired lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-deleted-03a34e53-9211-402c-91eb-334ff8f88642 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:46:59 user nova-compute[75648]: INFO nova.compute.manager [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Neutron deleted interface 03a34e53-9211-402c-91eb-334ff8f88642; detaching it from the instance and deleting it from the info cache
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.objects.instance [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Lazy-loading 'system_metadata' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.objects.instance [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Lazy-loading 'flavor' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.objects.base [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Object Instance<3a095299-f948-48b7-aa05-ca494e9e5ec2> lazy-loaded attributes: system_metadata,flavor {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.network.os_vif_util [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Converting VIF {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.network.os_vif_util [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface> {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface>not found in domain: <domain type='kvm' id='26'>
Nov 15 05:46:59 user nova-compute[75648]:   <name>instance-00000016</name>
Nov 15 05:46:59 user nova-compute[75648]:   <uuid>3a095299-f948-48b7-aa05-ca494e9e5ec2</uuid>
Nov 15 05:46:59 user nova-compute[75648]:   <metadata>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:59 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:59</nova:creationTime>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:59 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:59 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:59 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:59 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:59 user nova-compute[75648]:   </metadata>
Nov 15 05:46:59 user nova-compute[75648]:   <memory unit='KiB'>524288</memory>
Nov 15 05:46:59 user nova-compute[75648]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 05:46:59 user nova-compute[75648]:   <vcpu placement='static'>1</vcpu>
Nov 15 05:46:59 user nova-compute[75648]:   <resource>
Nov 15 05:46:59 user nova-compute[75648]:     <partition>/machine</partition>
Nov 15 05:46:59 user nova-compute[75648]:   </resource>
Nov 15 05:46:59 user nova-compute[75648]:   <sysinfo type='smbios'>
Nov 15 05:46:59 user nova-compute[75648]:     <system>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='version'>0.0.0</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='serial'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='uuid'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='family'>Virtual Machine</entry>
Nov 15 05:46:59 user nova-compute[75648]:     </system>
Nov 15 05:46:59 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:59 user nova-compute[75648]:   <os>
Nov 15 05:46:59 user nova-compute[75648]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 05:46:59 user nova-compute[75648]:     <boot dev='hd'/>
Nov 15 05:46:59 user nova-compute[75648]:     <smbios mode='sysinfo'/>
Nov 15 05:46:59 user nova-compute[75648]:   </os>
Nov 15 05:46:59 user nova-compute[75648]:   <features>
Nov 15 05:46:59 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:59 user nova-compute[75648]:     <apic/>
Nov 15 05:46:59 user nova-compute[75648]:     <vmcoreinfo state='on'/>
Nov 15 05:46:59 user nova-compute[75648]:   </features>
Nov 15 05:46:59 user nova-compute[75648]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 05:46:59 user nova-compute[75648]:     <model fallback='forbid'>Nehalem</model>
Nov 15 05:46:59 user nova-compute[75648]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 05:46:59 user nova-compute[75648]:     <feature policy='require' name='vme'/>
Nov 15 05:46:59 user nova-compute[75648]:     <feature policy='require' name='x2apic'/>
Nov 15 05:46:59 user nova-compute[75648]:     <feature policy='require' name='hypervisor'/>
Nov 15 05:46:59 user nova-compute[75648]:   </cpu>
Nov 15 05:46:59 user nova-compute[75648]:   <clock offset='utc'>
Nov 15 05:46:59 user nova-compute[75648]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 05:46:59 user nova-compute[75648]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 05:46:59 user nova-compute[75648]:     <timer name='hpet' present='no'/>
Nov 15 05:46:59 user nova-compute[75648]:   </clock>
Nov 15 05:46:59 user nova-compute[75648]:   <on_poweroff>destroy</on_poweroff>
Nov 15 05:46:59 user nova-compute[75648]:   <on_reboot>restart</on_reboot>
Nov 15 05:46:59 user nova-compute[75648]:   <on_crash>destroy</on_crash>
Nov 15 05:46:59 user nova-compute[75648]:   <devices>
Nov 15 05:46:59 user nova-compute[75648]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 05:46:59 user nova-compute[75648]:     <disk type='file' device='disk'>
Nov 15 05:46:59 user nova-compute[75648]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 05:46:59 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk' index='2'/>
Nov 15 05:46:59 user nova-compute[75648]:       <backingStore type='file' index='3'>
Nov 15 05:46:59 user nova-compute[75648]:         <format type='raw'/>
Nov 15 05:46:59 user nova-compute[75648]:         <source file='/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a'/>
Nov 15 05:46:59 user nova-compute[75648]:         <backingStore/>
Nov 15 05:46:59 user nova-compute[75648]:       </backingStore>
Nov 15 05:46:59 user nova-compute[75648]:       <target dev='vda' bus='virtio'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='virtio-disk0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </disk>
Nov 15 05:46:59 user nova-compute[75648]:     <disk type='file' device='cdrom'>
Nov 15 05:46:59 user nova-compute[75648]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 05:46:59 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config' index='1'/>
Nov 15 05:46:59 user nova-compute[75648]:       <backingStore/>
Nov 15 05:46:59 user nova-compute[75648]:       <target dev='hda' bus='ide'/>
Nov 15 05:46:59 user nova-compute[75648]:       <readonly/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='ide0-0-0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </disk>
Nov 15 05:46:59 user nova-compute[75648]:     <controller type='usb' index='0' model='none'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='usb'/>
Nov 15 05:46:59 user nova-compute[75648]:     </controller>
Nov 15 05:46:59 user nova-compute[75648]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='pci.0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </controller>
Nov 15 05:46:59 user nova-compute[75648]:     <controller type='ide' index='0'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='ide'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 05:46:59 user nova-compute[75648]:     </controller>
Nov 15 05:46:59 user nova-compute[75648]:     <interface type='ethernet'>
Nov 15 05:46:59 user nova-compute[75648]:       <mac address='fa:16:3e:dd:95:c0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <target dev='tape5dc1ff4-df'/>
Nov 15 05:46:59 user nova-compute[75648]:       <model type='virtio'/>
Nov 15 05:46:59 user nova-compute[75648]:       <mtu size='1442'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='net0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </interface>
Nov 15 05:46:59 user nova-compute[75648]:     <serial type='pty'>
Nov 15 05:46:59 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:59 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:59 user nova-compute[75648]:       <target type='isa-serial' port='0'>
Nov 15 05:46:59 user nova-compute[75648]:         <model name='isa-serial'/>
Nov 15 05:46:59 user nova-compute[75648]:       </target>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </serial>
Nov 15 05:46:59 user nova-compute[75648]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 05:46:59 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:59 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:59 user nova-compute[75648]:       <target type='serial' port='0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </console>
Nov 15 05:46:59 user nova-compute[75648]:     <input type='mouse' bus='ps2'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='input0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </input>
Nov 15 05:46:59 user nova-compute[75648]:     <input type='keyboard' bus='ps2'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='input1'/>
Nov 15 05:46:59 user nova-compute[75648]:     </input>
Nov 15 05:46:59 user nova-compute[75648]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 05:46:59 user nova-compute[75648]:       <listen type='address' address='0.0.0.0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </graphics>
Nov 15 05:46:59 user nova-compute[75648]:     <audio id='1' type='none'/>
Nov 15 05:46:59 user nova-compute[75648]:     <video>
Nov 15 05:46:59 user nova-compute[75648]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='video0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </video>
Nov 15 05:46:59 user nova-compute[75648]:     <memballoon model='virtio'>
Nov 15 05:46:59 user nova-compute[75648]:       <stats period='10'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='balloon0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:59 user nova-compute[75648]:     <rng model='virtio'>
Nov 15 05:46:59 user nova-compute[75648]:       <backend model='random'>/dev/urandom</backend>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='rng0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </rng>
Nov 15 05:46:59 user nova-compute[75648]:   </devices>
Nov 15 05:46:59 user nova-compute[75648]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 05:46:59 user nova-compute[75648]:     <label>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</label>
Nov 15 05:46:59 user nova-compute[75648]:     <imagelabel>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</imagelabel>
Nov 15 05:46:59 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:59 user nova-compute[75648]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 05:46:59 user nova-compute[75648]:     <label>+64055:+108</label>
Nov 15 05:46:59 user nova-compute[75648]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 05:46:59 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:59 user nova-compute[75648]: </domain>
Nov 15 05:46:59 user nova-compute[75648]:  {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface> {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:f5:83:52"/><model type="virtio"/><mtu size="1442"/><target dev="tap03a34e53-92"/></interface>not found in domain: <domain type='kvm' id='26'>
Nov 15 05:46:59 user nova-compute[75648]:   <name>instance-00000016</name>
Nov 15 05:46:59 user nova-compute[75648]:   <uuid>3a095299-f948-48b7-aa05-ca494e9e5ec2</uuid>
Nov 15 05:46:59 user nova-compute[75648]:   <metadata>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:59 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:59</nova:creationTime>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:59 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:59 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:59 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:59 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:59 user nova-compute[75648]:   </metadata>
Nov 15 05:46:59 user nova-compute[75648]:   <memory unit='KiB'>524288</memory>
Nov 15 05:46:59 user nova-compute[75648]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 15 05:46:59 user nova-compute[75648]:   <vcpu placement='static'>1</vcpu>
Nov 15 05:46:59 user nova-compute[75648]:   <resource>
Nov 15 05:46:59 user nova-compute[75648]:     <partition>/machine</partition>
Nov 15 05:46:59 user nova-compute[75648]:   </resource>
Nov 15 05:46:59 user nova-compute[75648]:   <sysinfo type='smbios'>
Nov 15 05:46:59 user nova-compute[75648]:     <system>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='product'>OpenStack Nova</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='version'>0.0.0</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='serial'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='uuid'>3a095299-f948-48b7-aa05-ca494e9e5ec2</entry>
Nov 15 05:46:59 user nova-compute[75648]:       <entry name='family'>Virtual Machine</entry>
Nov 15 05:46:59 user nova-compute[75648]:     </system>
Nov 15 05:46:59 user nova-compute[75648]:   </sysinfo>
Nov 15 05:46:59 user nova-compute[75648]:   <os>
Nov 15 05:46:59 user nova-compute[75648]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 15 05:46:59 user nova-compute[75648]:     <boot dev='hd'/>
Nov 15 05:46:59 user nova-compute[75648]:     <smbios mode='sysinfo'/>
Nov 15 05:46:59 user nova-compute[75648]:   </os>
Nov 15 05:46:59 user nova-compute[75648]:   <features>
Nov 15 05:46:59 user nova-compute[75648]:     <acpi/>
Nov 15 05:46:59 user nova-compute[75648]:     <apic/>
Nov 15 05:46:59 user nova-compute[75648]:     <vmcoreinfo state='on'/>
Nov 15 05:46:59 user nova-compute[75648]:   </features>
Nov 15 05:46:59 user nova-compute[75648]:   <cpu mode='custom' match='exact' check='full'>
Nov 15 05:46:59 user nova-compute[75648]:     <model fallback='forbid'>Nehalem</model>
Nov 15 05:46:59 user nova-compute[75648]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 15 05:46:59 user nova-compute[75648]:     <feature policy='require' name='vme'/>
Nov 15 05:46:59 user nova-compute[75648]:     <feature policy='require' name='x2apic'/>
Nov 15 05:46:59 user nova-compute[75648]:     <feature policy='require' name='hypervisor'/>
Nov 15 05:46:59 user nova-compute[75648]:   </cpu>
Nov 15 05:46:59 user nova-compute[75648]:   <clock offset='utc'>
Nov 15 05:46:59 user nova-compute[75648]:     <timer name='pit' tickpolicy='delay'/>
Nov 15 05:46:59 user nova-compute[75648]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 15 05:46:59 user nova-compute[75648]:     <timer name='hpet' present='no'/>
Nov 15 05:46:59 user nova-compute[75648]:   </clock>
Nov 15 05:46:59 user nova-compute[75648]:   <on_poweroff>destroy</on_poweroff>
Nov 15 05:46:59 user nova-compute[75648]:   <on_reboot>restart</on_reboot>
Nov 15 05:46:59 user nova-compute[75648]:   <on_crash>destroy</on_crash>
Nov 15 05:46:59 user nova-compute[75648]:   <devices>
Nov 15 05:46:59 user nova-compute[75648]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 15 05:46:59 user nova-compute[75648]:     <disk type='file' device='disk'>
Nov 15 05:46:59 user nova-compute[75648]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 15 05:46:59 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk' index='2'/>
Nov 15 05:46:59 user nova-compute[75648]:       <backingStore type='file' index='3'>
Nov 15 05:46:59 user nova-compute[75648]:         <format type='raw'/>
Nov 15 05:46:59 user nova-compute[75648]:         <source file='/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a'/>
Nov 15 05:46:59 user nova-compute[75648]:         <backingStore/>
Nov 15 05:46:59 user nova-compute[75648]:       </backingStore>
Nov 15 05:46:59 user nova-compute[75648]:       <target dev='vda' bus='virtio'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='virtio-disk0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </disk>
Nov 15 05:46:59 user nova-compute[75648]:     <disk type='file' device='cdrom'>
Nov 15 05:46:59 user nova-compute[75648]:       <driver name='qemu' type='raw' cache='none'/>
Nov 15 05:46:59 user nova-compute[75648]:       <source file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/disk.config' index='1'/>
Nov 15 05:46:59 user nova-compute[75648]:       <backingStore/>
Nov 15 05:46:59 user nova-compute[75648]:       <target dev='hda' bus='ide'/>
Nov 15 05:46:59 user nova-compute[75648]:       <readonly/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='ide0-0-0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </disk>
Nov 15 05:46:59 user nova-compute[75648]:     <controller type='usb' index='0' model='none'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='usb'/>
Nov 15 05:46:59 user nova-compute[75648]:     </controller>
Nov 15 05:46:59 user nova-compute[75648]:     <controller type='pci' index='0' model='pci-root'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='pci.0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </controller>
Nov 15 05:46:59 user nova-compute[75648]:     <controller type='ide' index='0'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='ide'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 15 05:46:59 user nova-compute[75648]:     </controller>
Nov 15 05:46:59 user nova-compute[75648]:     <interface type='ethernet'>
Nov 15 05:46:59 user nova-compute[75648]:       <mac address='fa:16:3e:dd:95:c0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <target dev='tape5dc1ff4-df'/>
Nov 15 05:46:59 user nova-compute[75648]:       <model type='virtio'/>
Nov 15 05:46:59 user nova-compute[75648]:       <mtu size='1442'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='net0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </interface>
Nov 15 05:46:59 user nova-compute[75648]:     <serial type='pty'>
Nov 15 05:46:59 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:59 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:59 user nova-compute[75648]:       <target type='isa-serial' port='0'>
Nov 15 05:46:59 user nova-compute[75648]:         <model name='isa-serial'/>
Nov 15 05:46:59 user nova-compute[75648]:       </target>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </serial>
Nov 15 05:46:59 user nova-compute[75648]:     <console type='pty' tty='/dev/pts/6'>
Nov 15 05:46:59 user nova-compute[75648]:       <source path='/dev/pts/6'/>
Nov 15 05:46:59 user nova-compute[75648]:       <log file='/opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2/console.log' append='off'/>
Nov 15 05:46:59 user nova-compute[75648]:       <target type='serial' port='0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='serial0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </console>
Nov 15 05:46:59 user nova-compute[75648]:     <input type='mouse' bus='ps2'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='input0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </input>
Nov 15 05:46:59 user nova-compute[75648]:     <input type='keyboard' bus='ps2'>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='input1'/>
Nov 15 05:46:59 user nova-compute[75648]:     </input>
Nov 15 05:46:59 user nova-compute[75648]:     <graphics type='vnc' port='5904' autoport='yes' listen='0.0.0.0'>
Nov 15 05:46:59 user nova-compute[75648]:       <listen type='address' address='0.0.0.0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </graphics>
Nov 15 05:46:59 user nova-compute[75648]:     <audio id='1' type='none'/>
Nov 15 05:46:59 user nova-compute[75648]:     <video>
Nov 15 05:46:59 user nova-compute[75648]:       <model type='virtio' heads='1' primary='yes'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='video0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </video>
Nov 15 05:46:59 user nova-compute[75648]:     <memballoon model='virtio'>
Nov 15 05:46:59 user nova-compute[75648]:       <stats period='10'/>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='balloon0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </memballoon>
Nov 15 05:46:59 user nova-compute[75648]:     <rng model='virtio'>
Nov 15 05:46:59 user nova-compute[75648]:       <backend model='random'>/dev/urandom</backend>
Nov 15 05:46:59 user nova-compute[75648]:       <alias name='rng0'/>
Nov 15 05:46:59 user nova-compute[75648]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 15 05:46:59 user nova-compute[75648]:     </rng>
Nov 15 05:46:59 user nova-compute[75648]:   </devices>
Nov 15 05:46:59 user nova-compute[75648]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 15 05:46:59 user nova-compute[75648]:     <label>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</label>
Nov 15 05:46:59 user nova-compute[75648]:     <imagelabel>libvirt-3a095299-f948-48b7-aa05-ca494e9e5ec2</imagelabel>
Nov 15 05:46:59 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:59 user nova-compute[75648]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 15 05:46:59 user nova-compute[75648]:     <label>+64055:+108</label>
Nov 15 05:46:59 user nova-compute[75648]:     <imagelabel>+64055:+108</imagelabel>
Nov 15 05:46:59 user nova-compute[75648]:   </seclabel>
Nov 15 05:46:59 user nova-compute[75648]: </domain>
Nov 15 05:46:59 user nova-compute[75648]:  {{(pid=75648) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 15 05:46:59 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Detaching interface fa:16:3e:f5:83:52 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap03a34e53-92' not found.
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.network.os_vif_util [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Converting VIF {"id": "03a34e53-9211-402c-91eb-334ff8f88642", "address": "fa:16:3e:f5:83:52", "network": {"id": "c6d6d92b-ec24-46df-bbb9-992ba682b66f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-209176906", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.235", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03a34e53-92", "ovs_interfaceid": "03a34e53-9211-402c-91eb-334ff8f88642", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.network.os_vif_util [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG os_vif [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03a34e53-92, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:46:59 user nova-compute[75648]: INFO os_vif [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:83:52,bridge_name='br-int',has_traffic_filtering=True,id=03a34e53-9211-402c-91eb-334ff8f88642,network=Network(c6d6d92b-ec24-46df-bbb9-992ba682b66f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03a34e53-92')
Nov 15 05:46:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [req-fc6d1906-9aeb-4311-b58a-48e435aac408 req-57c786cb-1a35-4fb0-ad38-0fc2a8d27034 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:46:59 user nova-compute[75648]:   <nova:package version="0.0.0"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:name>tempest-device-tagging-server-1189351689</nova:name>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:creationTime>2023-11-15 05:46:59</nova:creationTime>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:flavor name="m1.tiny">
Nov 15 05:46:59 user nova-compute[75648]:     <nova:memory>512</nova:memory>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:disk>1</nova:disk>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:swap>0</nova:swap>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:vcpus>1</nova:vcpus>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:flavor>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:user uuid="000c6d537a8a4dbc9d7286083c5f6580">tempest-TaggedAttachmentsTest-1642127849-project-member</nova:user>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:project uuid="dfc975af351c474b82b020077f390c0e">tempest-TaggedAttachmentsTest-1642127849</nova:project>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:owner>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:46:59 user nova-compute[75648]:   <nova:ports>
Nov 15 05:46:59 user nova-compute[75648]:     <nova:port uuid="e5dc1ff4-df0c-4836-83e5-95b381eef061">
Nov 15 05:46:59 user nova-compute[75648]:       <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:46:59 user nova-compute[75648]:     </nova:port>
Nov 15 05:46:59 user nova-compute[75648]:   </nova:ports>
Nov 15 05:46:59 user nova-compute[75648]: </nova:instance>
Nov 15 05:46:59 user nova-compute[75648]:  {{(pid=75648) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 15 05:46:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:00 user nova-compute[75648]: INFO nova.network.neutron [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Port 03a34e53-9211-402c-91eb-334ff8f88642 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Nov 15 05:47:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [{"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Releasing lock "refresh_cache-3a095299-f948-48b7-aa05-ca494e9e5ec2" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d31721f6-5efd-45bc-8e9c-92c95018fa23 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "interface-3a095299-f948-48b7-aa05-ca494e9e5ec2-03a34e53-9211-402c-91eb-334ff8f88642" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.667s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:03 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-changed-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Refreshing instance network info cache due to event network-changed-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] Acquiring lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] Acquired lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Refreshing network info cache for port f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updated VIF entry in instance network info cache for port f7d1b16d-5c97-4c76-b9ca-dc0bd103288e. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updating instance_info_cache with network_info: [{"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:10 user nova-compute[75648]: INFO nova.compute.manager [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Terminating instance
Nov 15 05:47:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2fdd9f80-bfcb-48b9-a771-911ce7fd3bd6 req-5ab08af9-d199-4719-8fdb-012ff6838350 service nova] Releasing lock "refresh_cache-108cc4d3-aeab-4419-8cae-d5195cc5b0e8" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Instance destroyed successfully.
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'resources' on Instance uuid 108cc4d3-aeab-4419-8cae-d5195cc5b0e8 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-795048212',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-795048212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-795048212',id=23,image_ref='067f4566-c46a-4ea9-8672-a1bba02a6064',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIc567VGRHceZmGGqFGxklK+uQqsDQf3N9K2qBiW2bGN+idYZxhw0E+w6dc4RXs1SWt59zsbLPakpv7QqMGyH2HfvAGhwEnwMKsrkd2bFuVKurdcLKzytsJc7z+Dfi7ng==',key_name='tempest-keypair-2046693849',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:45:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-sldmqf5a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-522670763',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=108cc4d3-aeab-4419-8cae-d5195cc5b0e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "address": "fa:16:3e:f5:b1:82", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7d1b16d-5c", "ovs_interfaceid": "f7d1b16d-5c97-4c76-b9ca-dc0bd103288e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_vif [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7d1b16d-5c, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=18812f3e-b2db-4baf-ac3a-900bb958a8bf) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:11 user nova-compute[75648]: INFO os_vif [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:b1:82,bridge_name='br-int',has_traffic_filtering=True,id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7d1b16d-5c')
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tcuKAjiV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:47:11 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df8c60d-6d98-44aa-aff9-9baa3b98533d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:47:11 user nova-compute[75648]: No targets found.
Nov 15 05:47:11 user nova-compute[75648]: iSNS:
Nov 15 05:47:11 user nova-compute[75648]: No targets found.
Nov 15 05:47:11 user nova-compute[75648]: STATIC:
Nov 15 05:47:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:47:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807
Nov 15 05:47:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:47:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:47:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:11 user nova-compute[75648]: FIRMWARE:
Nov 15 05:47:11 user nova-compute[75648]: No targets found.
Nov 15 05:47:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:47:11 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:47:11 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac25142-01c7-4738-933c-e93e242facba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a89f48-4856-43d9-a4b0-3b17e221c97e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:47:11 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:47:11 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:47:11 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:47:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:47:11 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:47:11 user nova-compute[75648]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 (non-flash)
Nov 15 05:47:11 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:47:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e86b52d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807'): ({'sdg'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Removing single pathed devices sdg {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f2b58e-b9bb-470d-a75a-38fcfed816c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[91598c69-726b-443f-bb41-7324e8950423]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flushing IO for device /dev/sdg {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c3a1b4-39f6-4680-acb9-a4558d4731e1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea81e239-e3a5-4d8c-9a09-c179538ad0af]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b69295ac', '/dev/disk/by-id/scsi-26562333439663033', '/dev/disk/by-id/scsi-1SCST_BIOb69295ac-eb349f035d48b8c1') {{(pid=87015) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3424a24d-a4da-4ef3-b4a2-333a4c0d8ef9]: (4, None) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f6df2e-5f0f-4135-81c4-a7916f51fa2e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77376e5-b44b-4fc0-bbd9-1a455d00c586]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260]
Nov 15 05:47:11 user nova-compute[75648]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807, portal: 172.16.0.220,3260] successful.
Nov 15 05:47:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:606c096e-9463-4cbf-9fd0-0cd92313f807 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5659bb7e-0176-4fd0-a419-1a7672ff22ef]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== disconnect_volume: return (335ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:47:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Deleting instance files /opt/stack/data/nova/instances/108cc4d3-aeab-4419-8cae-d5195cc5b0e8_del
Nov 15 05:47:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Deletion of /opt/stack/data/nova/instances/108cc4d3-aeab-4419-8cae-d5195cc5b0e8_del complete
Nov 15 05:47:11 user nova-compute[75648]: INFO nova.compute.manager [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 15 05:47:11 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:47:11 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-vif-unplugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] No waiting events found dispatching network-vif-unplugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-vif-unplugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] Acquiring lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] No waiting events found dispatching network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:12 user nova-compute[75648]: WARNING nova.compute.manager [req-0cff3dc2-e445-44b1-bdd5-47bc3f040f47 req-8d6df946-122e-48df-8a33-76344c2b9af1 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received unexpected event network-vif-plugged-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e for instance with vm_state active and task_state deleting.
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:12 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Took 0.83 seconds to deallocate network for instance.
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-5bb354af-731e-4ade-983a-749311b84981 req-ce174d76-ac64-40ce-9bd7-37c82a6562f8 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Received event network-vif-deleted-f7d1b16d-5c97-4c76-b9ca-dc0bd103288e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:12 user nova-compute[75648]: INFO nova.compute.manager [req-5bb354af-731e-4ade-983a-749311b84981 req-ce174d76-ac64-40ce-9bd7-37c82a6562f8 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Neutron deleted interface f7d1b16d-5c97-4c76-b9ca-dc0bd103288e; detaching it from the instance and deleting it from the info cache
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.network.neutron [req-5bb354af-731e-4ade-983a-749311b84981 req-ce174d76-ac64-40ce-9bd7-37c82a6562f8 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-5bb354af-731e-4ade-983a-749311b84981 req-ce174d76-ac64-40ce-9bd7-37c82a6562f8 service nova] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Detach interface failed, port_id=f7d1b16d-5c97-4c76-b9ca-dc0bd103288e, reason: Instance 108cc4d3-aeab-4419-8cae-d5195cc5b0e8 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:47:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:13 user nova-compute[75648]: INFO nova.compute.manager [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 05:47:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 108cc4d3-aeab-4419-8cae-d5195cc5b0e8] Deleting volume: 606c096e-9463-4cbf-9fd0-0cd92313f807 {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 05:47:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:14 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Deleted allocations for instance 108cc4d3-aeab-4419-8cae-d5195cc5b0e8
Nov 15 05:47:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8d0bfc88-744b-454f-975c-77a69b6ae7f9 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "108cc4d3-aeab-4419-8cae-d5195cc5b0e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.639s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:47:14 user nova-compute[75648]: INFO nova.compute.claims [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Claim successful on node user
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.646s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:47:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.policy [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '143f1f9cdbe649ad9827f6b2ea96caeb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27934c845b394f498de55243765a8f51', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:47:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Creating image(s)
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "/opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "/opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "/opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Successfully created port: 27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.209s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk 1073741824" returned: 0 in 0.054s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Cannot resize image /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Ensure instance console log exists: /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Successfully updated port: 27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-changed-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Refreshing instance network info cache due to event network-changed-27a4e331-76e8-42b8-bfb0-7aa3d17a177c. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] Acquiring lock "refresh_cache-4981ff06-090a-40be-86d0-0fd12eb0cdd7" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] Acquired lock "refresh_cache-4981ff06-090a-40be-86d0-0fd12eb0cdd7" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Refreshing network info cache for port 27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "refresh_cache-4981ff06-090a-40be-86d0-0fd12eb0cdd7" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c6a8b21b-76e2-428f-92e1-7866aa3d15c8 req-9052071a-d54d-4f33-b276-5a3f79c03377 service nova] Releasing lock "refresh_cache-4981ff06-090a-40be-86d0-0fd12eb0cdd7" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquired lock "refresh_cache-4981ff06-090a-40be-86d0-0fd12eb0cdd7" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:47:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.network.neutron [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Updating instance_info_cache with network_info: [{"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Releasing lock "refresh_cache-4981ff06-090a-40be-86d0-0fd12eb0cdd7" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Instance network_info: |[{"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Start _get_guest_xml network_info=[{"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:47:17 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:17 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-234281588',display_name='tempest-ServersNegativeTestJSON-server-234281588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-234281588',id=28,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27934c845b394f498de55243765a8f51',ramdisk_id='',reservation_id='r-wi13l7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712721745',owner_user_name='tempest-ServersNegativeTestJSON-1712721745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:15Z,user_data=None,user_id='143f1f9cdbe649ad9827f6b2ea96caeb',uuid=4981ff06-090a-40be-86d0-0fd12eb0cdd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converting VIF {"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.objects.instance [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lazy-loading 'pci_devices' on Instance uuid 4981ff06-090a-40be-86d0-0fd12eb0cdd7 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:47:17 user nova-compute[75648]:   <uuid>4981ff06-090a-40be-86d0-0fd12eb0cdd7</uuid>
Nov 15 05:47:17 user nova-compute[75648]:   <name>instance-0000001c</name>
Nov 15 05:47:17 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:47:17 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:47:17 user nova-compute[75648]:   <metadata>
Nov 15 05:47:17 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:47:17 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:47:17 user nova-compute[75648]:       <nova:name>tempest-ServersNegativeTestJSON-server-234281588</nova:name>
Nov 15 05:47:17 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:47:17</nova:creationTime>
Nov 15 05:47:17 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:47:17 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:47:17 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:47:17 user nova-compute[75648]:       <nova:owner>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:user uuid="143f1f9cdbe649ad9827f6b2ea96caeb">tempest-ServersNegativeTestJSON-1712721745-project-member</nova:user>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:project uuid="27934c845b394f498de55243765a8f51">tempest-ServersNegativeTestJSON-1712721745</nova:project>
Nov 15 05:47:17 user nova-compute[75648]:       </nova:owner>
Nov 15 05:47:17 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:47:17 user nova-compute[75648]:       <nova:ports>
Nov 15 05:47:17 user nova-compute[75648]:         <nova:port uuid="27a4e331-76e8-42b8-bfb0-7aa3d17a177c">
Nov 15 05:47:17 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:47:17 user nova-compute[75648]:         </nova:port>
Nov 15 05:47:17 user nova-compute[75648]:       </nova:ports>
Nov 15 05:47:17 user nova-compute[75648]:     </nova:instance>
Nov 15 05:47:17 user nova-compute[75648]:   </metadata>
Nov 15 05:47:17 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:47:17 user nova-compute[75648]:     <system>
Nov 15 05:47:17 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:47:17 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:47:17 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:47:17 user nova-compute[75648]:       <entry name="serial">4981ff06-090a-40be-86d0-0fd12eb0cdd7</entry>
Nov 15 05:47:17 user nova-compute[75648]:       <entry name="uuid">4981ff06-090a-40be-86d0-0fd12eb0cdd7</entry>
Nov 15 05:47:17 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:47:17 user nova-compute[75648]:     </system>
Nov 15 05:47:17 user nova-compute[75648]:   </sysinfo>
Nov 15 05:47:17 user nova-compute[75648]:   <os>
Nov 15 05:47:17 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:47:17 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:47:17 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:47:17 user nova-compute[75648]:   </os>
Nov 15 05:47:17 user nova-compute[75648]:   <features>
Nov 15 05:47:17 user nova-compute[75648]:     <acpi/>
Nov 15 05:47:17 user nova-compute[75648]:     <apic/>
Nov 15 05:47:17 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:47:17 user nova-compute[75648]:   </features>
Nov 15 05:47:17 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:47:17 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:47:17 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:47:17 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:47:17 user nova-compute[75648]:   </clock>
Nov 15 05:47:17 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:47:17 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:47:17 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:47:17 user nova-compute[75648]:   </cpu>
Nov 15 05:47:17 user nova-compute[75648]:   <devices>
Nov 15 05:47:17 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:47:17 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:47:17 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk"/>
Nov 15 05:47:17 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:47:17 user nova-compute[75648]:     </disk>
Nov 15 05:47:17 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:47:17 user nova-compute[75648]:       <mac address="fa:16:3e:c4:a9:d1"/>
Nov 15 05:47:17 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:17 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:47:17 user nova-compute[75648]:       <target dev="tap27a4e331-76"/>
Nov 15 05:47:17 user nova-compute[75648]:     </interface>
Nov 15 05:47:17 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:47:17 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/console.log" append="off"/>
Nov 15 05:47:17 user nova-compute[75648]:     </serial>
Nov 15 05:47:17 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:47:17 user nova-compute[75648]:     <video>
Nov 15 05:47:17 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:17 user nova-compute[75648]:     </video>
Nov 15 05:47:17 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:47:17 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:47:17 user nova-compute[75648]:     </rng>
Nov 15 05:47:17 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:47:17 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:47:17 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:47:17 user nova-compute[75648]:     </memballoon>
Nov 15 05:47:17 user nova-compute[75648]:   </devices>
Nov 15 05:47:17 user nova-compute[75648]: </domain>
Nov 15 05:47:17 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-234281588',display_name='tempest-ServersNegativeTestJSON-server-234281588',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-234281588',id=28,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='27934c845b394f498de55243765a8f51',ramdisk_id='',reservation_id='r-wi13l7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1712721745',owner_user_name='tempest-ServersNegativeTestJSON-1712721745-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:15Z,user_data=None,user_id='143f1f9cdbe649ad9827f6b2ea96caeb',uuid=4981ff06-090a-40be-86d0-0fd12eb0cdd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converting VIF {"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG os_vif [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '99cca158-dd2f-52c9-9d39-f26264ed4788', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap27a4e331-76, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap27a4e331-76, col_values=(('qos', UUID('3189ba3a-2658-4630-b709-dd329f95af5d')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap27a4e331-76, col_values=(('external_ids', {'iface-id': '27a4e331-76e8-42b8-bfb0-7aa3d17a177c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:a9:d1', 'vm-uuid': '4981ff06-090a-40be-86d0-0fd12eb0cdd7'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:17 user nova-compute[75648]: INFO os_vif [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76')
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:47:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] No VIF found with MAC fa:16:3e:c4:a9:d1, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:47:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-9897fb83-051f-43bc-84f3-fac10f25f58d req-51e068d2-90c8-4759-b3f1-ac112463f1d8 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9897fb83-051f-43bc-84f3-fac10f25f58d req-51e068d2-90c8-4759-b3f1-ac112463f1d8 service nova] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9897fb83-051f-43bc-84f3-fac10f25f58d req-51e068d2-90c8-4759-b3f1-ac112463f1d8 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9897fb83-051f-43bc-84f3-fac10f25f58d req-51e068d2-90c8-4759-b3f1-ac112463f1d8 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-9897fb83-051f-43bc-84f3-fac10f25f58d req-51e068d2-90c8-4759-b3f1-ac112463f1d8 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] No waiting events found dispatching network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:19 user nova-compute[75648]: WARNING nova.compute.manager [req-9897fb83-051f-43bc-84f3-fac10f25f58d req-51e068d2-90c8-4759-b3f1-ac112463f1d8 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received unexpected event network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c for instance with vm_state building and task_state spawning.
Nov 15 05:47:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:20 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:47:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:20 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:47:20 user nova-compute[75648]: INFO nova.compute.claims [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Claim successful on node user
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:47:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Instance spawned successfully.
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:21 user nova-compute[75648]: INFO nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Took 5.84 seconds to spawn the instance on the hypervisor.
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:47:21 user nova-compute[75648]: INFO nova.compute.manager [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Took 6.93 seconds to build instance.
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-333f20d2-b748-437e-8aef-a0cdce9dd742 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.173s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-3f7e4ea1-3cb2-40b4-bb7b-c3f8fb33f6c3 req-cbfbb6f8-218b-4ace-b9b0-7f3d40381744 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3f7e4ea1-3cb2-40b4-bb7b-c3f8fb33f6c3 req-cbfbb6f8-218b-4ace-b9b0-7f3d40381744 service nova] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3f7e4ea1-3cb2-40b4-bb7b-c3f8fb33f6c3 req-cbfbb6f8-218b-4ace-b9b0-7f3d40381744 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3f7e4ea1-3cb2-40b4-bb7b-c3f8fb33f6c3 req-cbfbb6f8-218b-4ace-b9b0-7f3d40381744 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-3f7e4ea1-3cb2-40b4-bb7b-c3f8fb33f6c3 req-cbfbb6f8-218b-4ace-b9b0-7f3d40381744 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] No waiting events found dispatching network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:21 user nova-compute[75648]: WARNING nova.compute.manager [req-3f7e4ea1-3cb2-40b4-bb7b-c3f8fb33f6c3 req-cbfbb6f8-218b-4ace-b9b0-7f3d40381744 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received unexpected event network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c for instance with vm_state active and task_state None.
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:47:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.policy [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e20600cd4fd148b1b871195e1e5397d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ba132e2da344b8da008767a69ba0f3f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:47:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Creating image(s)
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.264s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk 1073741824" returned: 0 in 0.069s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Cannot resize image /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Ensure instance console log exists: /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:23 user nova-compute[75648]: DEBUG nova.network.neutron [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Successfully created port: 3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Successfully updated port: 3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-changed-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing instance network info cache due to event network-changed-3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "94a41326-1559-42e7-a95f-9e86259b26ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:47:24 user nova-compute[75648]: INFO nova.compute.claims [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Claim successful on node user
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance network_info: |[{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing network info cache for port 3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Start _get_guest_xml network_info=[{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:47:24 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:24 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-730897005',display_name='tempest-ServerRescueNegativeTestJSON-server-730897005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-730897005',id=29,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeNhKhjh86kt/gllTgX5pbI5QJTkapa+6W4wRQBQBUTTAwINIqglvygMmhbfqi6rGshznaBKU0r6XfR6gP05drx93phOsW24NEkoygCvnORjJoCAQ6Xsu7TVKnNRlrq1Q==',key_name='tempest-keypair-1093223766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-tis05mag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=2fe5ece1-e20e-432d-9af8-976dc679dea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:47:24 user nova-compute[75648]:   <uuid>2fe5ece1-e20e-432d-9af8-976dc679dea5</uuid>
Nov 15 05:47:24 user nova-compute[75648]:   <name>instance-0000001d</name>
Nov 15 05:47:24 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:47:24 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:47:24 user nova-compute[75648]:   <metadata>
Nov 15 05:47:24 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:47:24 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:47:24 user nova-compute[75648]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-730897005</nova:name>
Nov 15 05:47:24 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:47:24</nova:creationTime>
Nov 15 05:47:24 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:47:24 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:47:24 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:47:24 user nova-compute[75648]:       <nova:owner>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:user uuid="e20600cd4fd148b1b871195e1e5397d7">tempest-ServerRescueNegativeTestJSON-1116175393-project-member</nova:user>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:project uuid="1ba132e2da344b8da008767a69ba0f3f">tempest-ServerRescueNegativeTestJSON-1116175393</nova:project>
Nov 15 05:47:24 user nova-compute[75648]:       </nova:owner>
Nov 15 05:47:24 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:47:24 user nova-compute[75648]:       <nova:ports>
Nov 15 05:47:24 user nova-compute[75648]:         <nova:port uuid="3a03d778-0782-478e-b330-30ad6415e732">
Nov 15 05:47:24 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 05:47:24 user nova-compute[75648]:         </nova:port>
Nov 15 05:47:24 user nova-compute[75648]:       </nova:ports>
Nov 15 05:47:24 user nova-compute[75648]:     </nova:instance>
Nov 15 05:47:24 user nova-compute[75648]:   </metadata>
Nov 15 05:47:24 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:47:24 user nova-compute[75648]:     <system>
Nov 15 05:47:24 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:47:24 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:47:24 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:47:24 user nova-compute[75648]:       <entry name="serial">2fe5ece1-e20e-432d-9af8-976dc679dea5</entry>
Nov 15 05:47:24 user nova-compute[75648]:       <entry name="uuid">2fe5ece1-e20e-432d-9af8-976dc679dea5</entry>
Nov 15 05:47:24 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:47:24 user nova-compute[75648]:     </system>
Nov 15 05:47:24 user nova-compute[75648]:   </sysinfo>
Nov 15 05:47:24 user nova-compute[75648]:   <os>
Nov 15 05:47:24 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:47:24 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:47:24 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:47:24 user nova-compute[75648]:   </os>
Nov 15 05:47:24 user nova-compute[75648]:   <features>
Nov 15 05:47:24 user nova-compute[75648]:     <acpi/>
Nov 15 05:47:24 user nova-compute[75648]:     <apic/>
Nov 15 05:47:24 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:47:24 user nova-compute[75648]:   </features>
Nov 15 05:47:24 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:47:24 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:47:24 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:47:24 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:47:24 user nova-compute[75648]:   </clock>
Nov 15 05:47:24 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:47:24 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:47:24 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:47:24 user nova-compute[75648]:   </cpu>
Nov 15 05:47:24 user nova-compute[75648]:   <devices>
Nov 15 05:47:24 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:47:24 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:47:24 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk"/>
Nov 15 05:47:24 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:47:24 user nova-compute[75648]:     </disk>
Nov 15 05:47:24 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:47:24 user nova-compute[75648]:       <mac address="fa:16:3e:39:80:ca"/>
Nov 15 05:47:24 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:24 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:47:24 user nova-compute[75648]:       <target dev="tap3a03d778-07"/>
Nov 15 05:47:24 user nova-compute[75648]:     </interface>
Nov 15 05:47:24 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:47:24 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/console.log" append="off"/>
Nov 15 05:47:24 user nova-compute[75648]:     </serial>
Nov 15 05:47:24 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:47:24 user nova-compute[75648]:     <video>
Nov 15 05:47:24 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:24 user nova-compute[75648]:     </video>
Nov 15 05:47:24 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:47:24 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:47:24 user nova-compute[75648]:     </rng>
Nov 15 05:47:24 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:47:24 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:47:24 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:47:24 user nova-compute[75648]:     </memballoon>
Nov 15 05:47:24 user nova-compute[75648]:   </devices>
Nov 15 05:47:24 user nova-compute[75648]: </domain>
Nov 15 05:47:24 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-730897005',display_name='tempest-ServerRescueNegativeTestJSON-server-730897005',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-730897005',id=29,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeNhKhjh86kt/gllTgX5pbI5QJTkapa+6W4wRQBQBUTTAwINIqglvygMmhbfqi6rGshznaBKU0r6XfR6gP05drx93phOsW24NEkoygCvnORjJoCAQ6Xsu7TVKnNRlrq1Q==',key_name='tempest-keypair-1093223766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-tis05mag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=2fe5ece1-e20e-432d-9af8-976dc679dea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG os_vif [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd43e68a6-52c3-5cbe-a7d7-4150cbb5bf5d', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3a03d778-07, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3a03d778-07, col_values=(('qos', UUID('be160440-f67e-4c86-829d-e9ece7c80834')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3a03d778-07, col_values=(('external_ids', {'iface-id': '3a03d778-0782-478e-b330-30ad6415e732', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:80:ca', 'vm-uuid': '2fe5ece1-e20e-432d-9af8-976dc679dea5'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:24 user nova-compute[75648]: INFO os_vif [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07')
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:39:80:ca, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updated VIF entry in instance network info cache for port 3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.network.neutron [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.696s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:47:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-22ec493a-055e-429e-8270-1d3d18139f57 req-10e5a38c-100a-4a8f-97f2-acc60458aa33 service nova] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:47:25 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:47:25 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Creating image(s)
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.policy [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47b4817a59584433a28790c3a16d0b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13f9a55b45f4f9992e2f86628b34982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.204s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk 1073741824" returned: 0 in 0.048s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Successfully created port: e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:47:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Cannot resize image /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Ensure instance console log exists: /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG nova.compute.manager [req-19bf6d05-2b48-46ef-9ef3-2f8b70499f9d req-3e808b1e-823c-4a32-ab17-9c107600410f service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-19bf6d05-2b48-46ef-9ef3-2f8b70499f9d req-3e808b1e-823c-4a32-ab17-9c107600410f service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-19bf6d05-2b48-46ef-9ef3-2f8b70499f9d req-3e808b1e-823c-4a32-ab17-9c107600410f service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-19bf6d05-2b48-46ef-9ef3-2f8b70499f9d req-3e808b1e-823c-4a32-ab17-9c107600410f service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:26 user nova-compute[75648]: DEBUG nova.compute.manager [req-19bf6d05-2b48-46ef-9ef3-2f8b70499f9d req-3e808b1e-823c-4a32-ab17-9c107600410f service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:26 user nova-compute[75648]: WARNING nova.compute.manager [req-19bf6d05-2b48-46ef-9ef3-2f8b70499f9d req-3e808b1e-823c-4a32-ab17-9c107600410f service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state building and task_state spawning.
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Successfully updated port: e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Updating instance_info_cache with network_info: [{"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Instance network_info: |[{"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Start _get_guest_xml network_info=[{"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:47:27 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:27 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1341006442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1341006442',id=30,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-53ed82va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:25Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=94a41326-1559-42e7-a95f-9e86259b26ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a41326-1559-42e7-a95f-9e86259b26ef {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:47:27 user nova-compute[75648]:   <uuid>94a41326-1559-42e7-a95f-9e86259b26ef</uuid>
Nov 15 05:47:27 user nova-compute[75648]:   <name>instance-0000001e</name>
Nov 15 05:47:27 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:47:27 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:47:27 user nova-compute[75648]:   <metadata>
Nov 15 05:47:27 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:47:27 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:47:27 user nova-compute[75648]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1341006442</nova:name>
Nov 15 05:47:27 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:47:27</nova:creationTime>
Nov 15 05:47:27 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:47:27 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:47:27 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:47:27 user nova-compute[75648]:       <nova:owner>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:user uuid="47b4817a59584433a28790c3a16d0b5c">tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member</nova:user>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:project uuid="c13f9a55b45f4f9992e2f86628b34982">tempest-ServerBootFromVolumeStableRescueTest-893883912</nova:project>
Nov 15 05:47:27 user nova-compute[75648]:       </nova:owner>
Nov 15 05:47:27 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:47:27 user nova-compute[75648]:       <nova:ports>
Nov 15 05:47:27 user nova-compute[75648]:         <nova:port uuid="e53db8ff-23fe-434b-98cc-38c4fbc35114">
Nov 15 05:47:27 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 05:47:27 user nova-compute[75648]:         </nova:port>
Nov 15 05:47:27 user nova-compute[75648]:       </nova:ports>
Nov 15 05:47:27 user nova-compute[75648]:     </nova:instance>
Nov 15 05:47:27 user nova-compute[75648]:   </metadata>
Nov 15 05:47:27 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:47:27 user nova-compute[75648]:     <system>
Nov 15 05:47:27 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:47:27 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:47:27 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:47:27 user nova-compute[75648]:       <entry name="serial">94a41326-1559-42e7-a95f-9e86259b26ef</entry>
Nov 15 05:47:27 user nova-compute[75648]:       <entry name="uuid">94a41326-1559-42e7-a95f-9e86259b26ef</entry>
Nov 15 05:47:27 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:47:27 user nova-compute[75648]:     </system>
Nov 15 05:47:27 user nova-compute[75648]:   </sysinfo>
Nov 15 05:47:27 user nova-compute[75648]:   <os>
Nov 15 05:47:27 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:47:27 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:47:27 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:47:27 user nova-compute[75648]:   </os>
Nov 15 05:47:27 user nova-compute[75648]:   <features>
Nov 15 05:47:27 user nova-compute[75648]:     <acpi/>
Nov 15 05:47:27 user nova-compute[75648]:     <apic/>
Nov 15 05:47:27 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:47:27 user nova-compute[75648]:   </features>
Nov 15 05:47:27 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:47:27 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:47:27 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:47:27 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:47:27 user nova-compute[75648]:   </clock>
Nov 15 05:47:27 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:47:27 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:47:27 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:47:27 user nova-compute[75648]:   </cpu>
Nov 15 05:47:27 user nova-compute[75648]:   <devices>
Nov 15 05:47:27 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:47:27 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:47:27 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk"/>
Nov 15 05:47:27 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:47:27 user nova-compute[75648]:     </disk>
Nov 15 05:47:27 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:47:27 user nova-compute[75648]:       <mac address="fa:16:3e:e8:70:6c"/>
Nov 15 05:47:27 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:27 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:47:27 user nova-compute[75648]:       <target dev="tape53db8ff-23"/>
Nov 15 05:47:27 user nova-compute[75648]:     </interface>
Nov 15 05:47:27 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:47:27 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/console.log" append="off"/>
Nov 15 05:47:27 user nova-compute[75648]:     </serial>
Nov 15 05:47:27 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:47:27 user nova-compute[75648]:     <video>
Nov 15 05:47:27 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:27 user nova-compute[75648]:     </video>
Nov 15 05:47:27 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:47:27 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:47:27 user nova-compute[75648]:     </rng>
Nov 15 05:47:27 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:47:27 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:47:27 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:47:27 user nova-compute[75648]:     </memballoon>
Nov 15 05:47:27 user nova-compute[75648]:   </devices>
Nov 15 05:47:27 user nova-compute[75648]: </domain>
Nov 15 05:47:27 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1341006442',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1341006442',id=30,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-53ed82va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:25Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=94a41326-1559-42e7-a95f-9e86259b26ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG os_vif [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dd50b27-1e2d-57e3-9e87-894ac4dc77cb', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape53db8ff-23, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape53db8ff-23, col_values=(('qos', UUID('a7dc8478-e562-4da1-8ac0-8a20eabb84d4')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape53db8ff-23, col_values=(('external_ids', {'iface-id': 'e53db8ff-23fe-434b-98cc-38c4fbc35114', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:70:6c', 'vm-uuid': '94a41326-1559-42e7-a95f-9e86259b26ef'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:27 user nova-compute[75648]: INFO os_vif [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23')
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No VIF found with MAC fa:16:3e:e8:70:6c, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:47:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:28 user nova-compute[75648]: WARNING nova.compute.manager [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state building and task_state spawning.
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-changed-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Refreshing instance network info cache due to event network-changed-e53db8ff-23fe-434b-98cc-38c4fbc35114. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] Acquiring lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] Acquired lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Refreshing network info cache for port e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:47:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance spawned successfully.
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:29 user nova-compute[75648]: INFO nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Took 7.37 seconds to spawn the instance on the hypervisor.
Nov 15 05:47:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: INFO nova.compute.manager [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Took 8.33 seconds to build instance.
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-00e3e3f9-e1c9-4451-8c24-724495548193 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.446s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:29 user nova-compute[75648]: INFO nova.compute.manager [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Terminating instance
Nov 15 05:47:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG nova.network.neutron [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Updated VIF entry in instance network info cache for port e53db8ff-23fe-434b-98cc-38c4fbc35114. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG nova.network.neutron [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Updating instance_info_cache with network_info: [{"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fdabb249-8ca0-480e-b2e0-082dfb9d571c req-5cdbb88a-8ee1-4827-8223-0fe224abbdda service nova] Releasing lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Instance destroyed successfully.
Nov 15 05:47:30 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lazy-loading 'resources' on Instance uuid 3a095299-f948-48b7-aa05-ca494e9e5ec2 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-15T05:44:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1189351689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1189351689',id=22,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF48x+pGY/HC91kDlvLEa1WrRp/PDW2DYYjtigYKugaYmXH/h2+gwSXmQZ25NEl5iFsApXyfu8mpwupIwn/nE8GX2tjZOnKkd+q0yibNJC0edMl8EubhYYUHRMVV/vxEGQ==',key_name='tempest-keypair-2141835254',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfc975af351c474b82b020077f390c0e',ramdisk_id='',reservation_id='r-v06506xi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1642127849',owner_user_name='tempest-TaggedAttachmentsTest-1642127849-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:44:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='000c6d537a8a4dbc9d7286083c5f6580',uuid=3a095299-f948-48b7-aa05-ca494e9e5ec2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converting VIF {"id": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "address": "fa:16:3e:dd:95:c0", "network": {"id": "e7f8dfd7-2e35-463e-8602-c500b4bda45f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-4871421-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfc975af351c474b82b020077f390c0e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5dc1ff4-df", "ovs_interfaceid": "e5dc1ff4-df0c-4836-83e5-95b381eef061", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG os_vif [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5dc1ff4-df, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d583e0c-dc91-4c60-b2dd-9016aec02c5a) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:30 user nova-compute[75648]: INFO os_vif [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:95:c0,bridge_name='br-int',has_traffic_filtering=True,id=e5dc1ff4-df0c-4836-83e5-95b381eef061,network=Network(e7f8dfd7-2e35-463e-8602-c500b4bda45f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5dc1ff4-df')
Nov 15 05:47:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Deleting instance files /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2_del
Nov 15 05:47:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Deletion of /opt/stack/data/nova/instances/3a095299-f948-48b7-aa05-ca494e9e5ec2_del complete
Nov 15 05:47:30 user nova-compute[75648]: INFO nova.compute.manager [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 15 05:47:30 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:47:30 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-767870db-706d-48bf-bd54-14f43fec45fb req-bc4902d6-51bd-4321-a593-fbafedf6a5f6 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Received event network-vif-deleted-e5dc1ff4-df0c-4836-83e5-95b381eef061 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:31 user nova-compute[75648]: INFO nova.compute.manager [req-767870db-706d-48bf-bd54-14f43fec45fb req-bc4902d6-51bd-4321-a593-fbafedf6a5f6 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Neutron deleted interface e5dc1ff4-df0c-4836-83e5-95b381eef061; detaching it from the instance and deleting it from the info cache
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.network.neutron [req-767870db-706d-48bf-bd54-14f43fec45fb req-bc4902d6-51bd-4321-a593-fbafedf6a5f6 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:31 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Took 0.79 seconds to deallocate network for instance.
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-767870db-706d-48bf-bd54-14f43fec45fb req-bc4902d6-51bd-4321-a593-fbafedf6a5f6 service nova] [instance: 3a095299-f948-48b7-aa05-ca494e9e5ec2] Detach interface failed, port_id=e5dc1ff4-df0c-4836-83e5-95b381eef061, reason: Instance 3a095299-f948-48b7-aa05-ca494e9e5ec2 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:47:31 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Instance spawned successfully.
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:31 user nova-compute[75648]: INFO nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Took 6.71 seconds to spawn the instance on the hypervisor.
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:47:31 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:47:32 user nova-compute[75648]: INFO nova.compute.manager [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Took 7.83 seconds to build instance.
Nov 15 05:47:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c64c4c0d-ae53-4bdc-a876-69f7af9a4d81 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "94a41326-1559-42e7-a95f-9e86259b26ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.022s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.795s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:32 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Deleted allocations for instance 3a095299-f948-48b7-aa05-ca494e9e5ec2
Nov 15 05:47:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4db8d29d-8746-4406-ae51-5ab69c966b90 tempest-TaggedAttachmentsTest-1642127849 tempest-TaggedAttachmentsTest-1642127849-project-member] Lock "3a095299-f948-48b7-aa05-ca494e9e5ec2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.039s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing instance network info cache due to event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updated VIF entry in instance network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-57aa0e36-53dc-49ec-97d7-76f75dd3ffe4 req-13d979e2-1131-4179-b906-0ff9f8c6a1ef service nova] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-70056f7c-54eb-40dd-8382-b4af36937bad req-75c6b5b9-2ea6-46d1-8d13-443b5b440fae service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-70056f7c-54eb-40dd-8382-b4af36937bad req-75c6b5b9-2ea6-46d1-8d13-443b5b440fae service nova] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-70056f7c-54eb-40dd-8382-b4af36937bad req-75c6b5b9-2ea6-46d1-8d13-443b5b440fae service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-70056f7c-54eb-40dd-8382-b4af36937bad req-75c6b5b9-2ea6-46d1-8d13-443b5b440fae service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-70056f7c-54eb-40dd-8382-b4af36937bad req-75c6b5b9-2ea6-46d1-8d13-443b5b440fae service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] No waiting events found dispatching network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:34 user nova-compute[75648]: WARNING nova.compute.manager [req-70056f7c-54eb-40dd-8382-b4af36937bad req-75c6b5b9-2ea6-46d1-8d13-443b5b440fae service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received unexpected event network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 for instance with vm_state active and task_state None.
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing instance network info cache due to event network-changed-ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] Acquiring lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] Acquired lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Refreshing network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:35 user nova-compute[75648]: INFO nova.compute.manager [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Detaching volume e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:47:35 user nova-compute[75648]: INFO nova.virt.block_device [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Attempting to driver detach volume e59916ca-98db-4212-980b-cf1081099a61 from mountpoint /dev/vdb
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Attempting to detach device vdb from instance 40448f79-0cbc-462a-be88-050f97128a07 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:47:35 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:47:35 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:47:35 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:47:35 user nova-compute[75648]:   <serial>e59916ca-98db-4212-980b-cf1081099a61</serial>
Nov 15 05:47:35 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 05:47:35 user nova-compute[75648]: </disk>
Nov 15 05:47:35 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:47:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully detached device vdb from instance 40448f79-0cbc-462a-be88-050f97128a07 from the persistent domain config.
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 40448f79-0cbc-462a-be88-050f97128a07 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:47:35 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:47:35 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:47:35 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:47:35 user nova-compute[75648]:   <serial>e59916ca-98db-4212-980b-cf1081099a61</serial>
Nov 15 05:47:35 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 05:47:35 user nova-compute[75648]: </disk>
Nov 15 05:47:35 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updated VIF entry in instance network info cache for port ae26706e-3298-4eb3-a239-efe30a80ab1f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [{"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bf8673ef-2d7e-4d35-a191-d8312fcb1d74 req-61cdbd25-c26c-4279-9095-aa5736bbc125 service nova] Releasing lock "refresh_cache-40448f79-0cbc-462a-be88-050f97128a07" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:47:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-325c9f6a-bc66-405f-ad8f-5c1c55a4130b req-d4f2f17d-6e33-4328-aebb-ca55dd4e858a service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-325c9f6a-bc66-405f-ad8f-5c1c55a4130b req-d4f2f17d-6e33-4328-aebb-ca55dd4e858a service nova] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-325c9f6a-bc66-405f-ad8f-5c1c55a4130b req-d4f2f17d-6e33-4328-aebb-ca55dd4e858a service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-325c9f6a-bc66-405f-ad8f-5c1c55a4130b req-d4f2f17d-6e33-4328-aebb-ca55dd4e858a service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-325c9f6a-bc66-405f-ad8f-5c1c55a4130b req-d4f2f17d-6e33-4328-aebb-ca55dd4e858a service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] No waiting events found dispatching network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:36 user nova-compute[75648]: WARNING nova.compute.manager [req-325c9f6a-bc66-405f-ad8f-5c1c55a4130b req-d4f2f17d-6e33-4328-aebb-ca55dd4e858a service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received unexpected event network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 for instance with vm_state active and task_state None.
Nov 15 05:47:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:47:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:38 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:47:38 user nova-compute[75648]: INFO nova.compute.claims [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Claim successful on node user
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.915s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:47:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:47:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.policy [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b746581c3514859949345b4a3c3b03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f018e72ae1144091adb4ae568a3926a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:47:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Creating image(s)
Nov 15 05:47:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "/opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "/opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.275s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.229s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk 1073741824" returned: 0 in 0.070s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Successfully created port: b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.259s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:47:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Cannot resize image /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Ensure instance console log exists: /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Successfully updated port: b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquired lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-changed-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Refreshing instance network info cache due to event network-changed-b14524ce-ee45-46c9-bedb-5bebb63aa2d1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] Acquiring lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updating instance_info_cache with network_info: [{"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Releasing lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Instance network_info: |[{"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] Acquired lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Refreshing network info cache for port b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Start _get_guest_xml network_info=[{"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:47:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-987070567',display_name='tempest-VolumesSnapshotTestJSON-instance-987070567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-987070567',id=31,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIGNcvquQfhECzB4O8awvlxEAt3erdm1nCFZX9nVmiUvhSJfKC/CiuAPbZVGObLkc4dCxQWJnI/B5tjqQCYJHaNrHvNtldnQN8UqW+HtDxONmDjLaC2D8bsgRLLDhdXbA==',key_name='tempest-keypair-821080195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f018e72ae1144091adb4ae568a3926a0',ramdisk_id='',reservation_id='r-m26ky5lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1092113651',owner_user_name='tempest-VolumesSnapshotTestJSON-1092113651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b746581c3514859949345b4a3c3b03c',uuid=c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converting VIF {"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'pci_devices' on Instance uuid c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:47:41 user nova-compute[75648]:   <uuid>c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e</uuid>
Nov 15 05:47:41 user nova-compute[75648]:   <name>instance-0000001f</name>
Nov 15 05:47:41 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:47:41 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:47:41 user nova-compute[75648]:   <metadata>
Nov 15 05:47:41 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:47:41 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:47:41 user nova-compute[75648]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-987070567</nova:name>
Nov 15 05:47:41 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:47:41</nova:creationTime>
Nov 15 05:47:41 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:47:41 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:47:41 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:47:41 user nova-compute[75648]:       <nova:owner>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:user uuid="2b746581c3514859949345b4a3c3b03c">tempest-VolumesSnapshotTestJSON-1092113651-project-member</nova:user>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:project uuid="f018e72ae1144091adb4ae568a3926a0">tempest-VolumesSnapshotTestJSON-1092113651</nova:project>
Nov 15 05:47:41 user nova-compute[75648]:       </nova:owner>
Nov 15 05:47:41 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:47:41 user nova-compute[75648]:       <nova:ports>
Nov 15 05:47:41 user nova-compute[75648]:         <nova:port uuid="b14524ce-ee45-46c9-bedb-5bebb63aa2d1">
Nov 15 05:47:41 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:47:41 user nova-compute[75648]:         </nova:port>
Nov 15 05:47:41 user nova-compute[75648]:       </nova:ports>
Nov 15 05:47:41 user nova-compute[75648]:     </nova:instance>
Nov 15 05:47:41 user nova-compute[75648]:   </metadata>
Nov 15 05:47:41 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:47:41 user nova-compute[75648]:     <system>
Nov 15 05:47:41 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:47:41 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:47:41 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:47:41 user nova-compute[75648]:       <entry name="serial">c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e</entry>
Nov 15 05:47:41 user nova-compute[75648]:       <entry name="uuid">c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e</entry>
Nov 15 05:47:41 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:47:41 user nova-compute[75648]:     </system>
Nov 15 05:47:41 user nova-compute[75648]:   </sysinfo>
Nov 15 05:47:41 user nova-compute[75648]:   <os>
Nov 15 05:47:41 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:47:41 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:47:41 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:47:41 user nova-compute[75648]:   </os>
Nov 15 05:47:41 user nova-compute[75648]:   <features>
Nov 15 05:47:41 user nova-compute[75648]:     <acpi/>
Nov 15 05:47:41 user nova-compute[75648]:     <apic/>
Nov 15 05:47:41 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:47:41 user nova-compute[75648]:   </features>
Nov 15 05:47:41 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:47:41 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:47:41 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:47:41 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:47:41 user nova-compute[75648]:   </clock>
Nov 15 05:47:41 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:47:41 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:47:41 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:47:41 user nova-compute[75648]:   </cpu>
Nov 15 05:47:41 user nova-compute[75648]:   <devices>
Nov 15 05:47:41 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:47:41 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:47:41 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk"/>
Nov 15 05:47:41 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:47:41 user nova-compute[75648]:     </disk>
Nov 15 05:47:41 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:47:41 user nova-compute[75648]:       <mac address="fa:16:3e:67:6d:e7"/>
Nov 15 05:47:41 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:41 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:47:41 user nova-compute[75648]:       <target dev="tapb14524ce-ee"/>
Nov 15 05:47:41 user nova-compute[75648]:     </interface>
Nov 15 05:47:41 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:47:41 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/console.log" append="off"/>
Nov 15 05:47:41 user nova-compute[75648]:     </serial>
Nov 15 05:47:41 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:47:41 user nova-compute[75648]:     <video>
Nov 15 05:47:41 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:47:41 user nova-compute[75648]:     </video>
Nov 15 05:47:41 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:47:41 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:47:41 user nova-compute[75648]:     </rng>
Nov 15 05:47:41 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:47:41 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:47:41 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:47:41 user nova-compute[75648]:     </memballoon>
Nov 15 05:47:41 user nova-compute[75648]:   </devices>
Nov 15 05:47:41 user nova-compute[75648]: </domain>
Nov 15 05:47:41 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-987070567',display_name='tempest-VolumesSnapshotTestJSON-instance-987070567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-987070567',id=31,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIGNcvquQfhECzB4O8awvlxEAt3erdm1nCFZX9nVmiUvhSJfKC/CiuAPbZVGObLkc4dCxQWJnI/B5tjqQCYJHaNrHvNtldnQN8UqW+HtDxONmDjLaC2D8bsgRLLDhdXbA==',key_name='tempest-keypair-821080195',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f018e72ae1144091adb4ae568a3926a0',ramdisk_id='',reservation_id='r-m26ky5lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1092113651',owner_user_name='tempest-VolumesSnapshotTestJSON-1092113651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b746581c3514859949345b4a3c3b03c',uuid=c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converting VIF {"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG os_vif [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9931390-5a2f-5b90-a2fb-7880fa1f46cb', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14524ce-ee, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb14524ce-ee, col_values=(('qos', UUID('c86f494c-b148-467c-8935-dec3a264f1f1')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb14524ce-ee, col_values=(('external_ids', {'iface-id': 'b14524ce-ee45-46c9-bedb-5bebb63aa2d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:6d:e7', 'vm-uuid': 'c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:41 user nova-compute[75648]: INFO os_vif [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee')
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:47:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No VIF found with MAC fa:16:3e:67:6d:e7, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:47:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updated VIF entry in instance network info cache for port b14524ce-ee45-46c9-bedb-5bebb63aa2d1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updating instance_info_cache with network_info: [{"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-04648d87-d502-449a-bf20-431b20fac853 req-f00cb20a-b1ad-45f0-92ca-1276da16a472 service nova] Releasing lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-8f36df5a-80da-4b4b-b3fd-8c19a95f6cf0 req-c6498ed5-dd0d-45b0-bc4a-3c4ea0458e97 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f36df5a-80da-4b4b-b3fd-8c19a95f6cf0 req-c6498ed5-dd0d-45b0-bc4a-3c4ea0458e97 service nova] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f36df5a-80da-4b4b-b3fd-8c19a95f6cf0 req-c6498ed5-dd0d-45b0-bc4a-3c4ea0458e97 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f36df5a-80da-4b4b-b3fd-8c19a95f6cf0 req-c6498ed5-dd0d-45b0-bc4a-3c4ea0458e97 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-8f36df5a-80da-4b4b-b3fd-8c19a95f6cf0 req-c6498ed5-dd0d-45b0-bc4a-3c4ea0458e97 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] No waiting events found dispatching network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:44 user nova-compute[75648]: WARNING nova.compute.manager [req-8f36df5a-80da-4b4b-b3fd-8c19a95f6cf0 req-c6498ed5-dd0d-45b0-bc4a-3c4ea0458e97 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received unexpected event network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 for instance with vm_state building and task_state spawning.
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:47:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Instance spawned successfully.
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:47:45 user nova-compute[75648]: INFO nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Took 5.71 seconds to spawn the instance on the hypervisor.
Nov 15 05:47:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:47:45 user nova-compute[75648]: INFO nova.compute.manager [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Took 6.99 seconds to build instance.
Nov 15 05:47:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8503e560-bba6-4cca-a121-7dd730553f28 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.097s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-8f7c1696-c9da-44d4-902c-c8c74a4e2919 req-1188800c-2374-4633-b69e-1a3cf9d76641 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f7c1696-c9da-44d4-902c-c8c74a4e2919 req-1188800c-2374-4633-b69e-1a3cf9d76641 service nova] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f7c1696-c9da-44d4-902c-c8c74a4e2919 req-1188800c-2374-4633-b69e-1a3cf9d76641 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8f7c1696-c9da-44d4-902c-c8c74a4e2919 req-1188800c-2374-4633-b69e-1a3cf9d76641 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-8f7c1696-c9da-44d4-902c-c8c74a4e2919 req-1188800c-2374-4633-b69e-1a3cf9d76641 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] No waiting events found dispatching network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:47:46 user nova-compute[75648]: WARNING nova.compute.manager [req-8f7c1696-c9da-44d4-902c-c8c74a4e2919 req-1188800c-2374-4633-b69e-1a3cf9d76641 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received unexpected event network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 for instance with vm_state active and task_state None.
Nov 15 05:47:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:47:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:47:55 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 40448f79-0cbc-462a-be88-050f97128a07 is timed out.
Nov 15 05:47:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully detached device vdb from instance 40448f79-0cbc-462a-be88-050f97128a07 from the live domain config.
Nov 15 05:47:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QbKCZtJd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:47:56 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72007b9-0055-40b3-bccc-78849590a0aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:47:56 user nova-compute[75648]: No targets found.
Nov 15 05:47:56 user nova-compute[75648]: iSNS:
Nov 15 05:47:56 user nova-compute[75648]: No targets found.
Nov 15 05:47:56 user nova-compute[75648]: STATIC:
Nov 15 05:47:56 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61
Nov 15 05:47:56 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:56 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:56 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:47:56 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:56 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:56 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:47:56 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:47:56 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:47:56 user nova-compute[75648]: FIRMWARE:
Nov 15 05:47:56 user nova-compute[75648]: No targets found.
Nov 15 05:47:56 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:47:56 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:47:56 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d57b3a8-5f46-44df-88d6-65444f60d456]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5621f720-299a-455a-892b-f4ce70d0038a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:47:56 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:47:56 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:47:56 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:47:56 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:47:56 user nova-compute[75648]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 (non-flash)
Nov 15 05:47:56 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9f1583130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a48974-c442-4b52-b9ce-b29867a3cccc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d71c8d-6068-4881-bb46-b568d77f8966]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[832ee7f3-6f2e-4e74-b88b-66b810c717e3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f48fe9-349c-4dca-b254-566ac3930202]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[675568a5-0d41-4ea4-b74e-2a114cf693bb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3803476-4707-4cff-9927-5ad8dda2a9a2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260]
Nov 15 05:47:56 user nova-compute[75648]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61, portal: 172.16.0.220,3260] successful.
Nov 15 05:47:56 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e59916ca-98db-4212-980b-cf1081099a61 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe2d25d-0987-4522-b5fd-0ee01ab0fb6e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.635s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== disconnect_volume: return (636ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'flavor' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3d6bad5a-e441-4a1d-892c-dff166696bbc tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.068s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:47:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-changed-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Refreshing instance network info cache due to event network-changed-c5e72138-d273-4bb1-ac14-8e5f88e04114. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Refreshing network info cache for port c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updated VIF entry in instance network info cache for port c5e72138-d273-4bb1-ac14-8e5f88e04114. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fc5b9f10-ecdd-4612-a155-a9ed0945e327 req-4706e0ad-db29-4a9a-ace9-5c0091f23dae service nova] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:47:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:48:02 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=6887MB free_disk=25.103424072265625GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:02 user nova-compute[75648]: INFO nova.compute.manager [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Terminating instance
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 40448f79-0cbc-462a-be88-050f97128a07 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 28e59728-466d-47b7-bdbb-96ce43e78280 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 4981ff06-090a-40be-86d0-0fd12eb0cdd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-cb032293-1d55-47ee-8db0-2f9216c92fd3 req-56d8ff68-73d4-4730-94a7-a6701bf03361 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-vif-unplugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cb032293-1d55-47ee-8db0-2f9216c92fd3 req-56d8ff68-73d4-4730-94a7-a6701bf03361 service nova] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cb032293-1d55-47ee-8db0-2f9216c92fd3 req-56d8ff68-73d4-4730-94a7-a6701bf03361 service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cb032293-1d55-47ee-8db0-2f9216c92fd3 req-56d8ff68-73d4-4730-94a7-a6701bf03361 service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-cb032293-1d55-47ee-8db0-2f9216c92fd3 req-56d8ff68-73d4-4730-94a7-a6701bf03361 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] No waiting events found dispatching network-vif-unplugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-cb032293-1d55-47ee-8db0-2f9216c92fd3 req-56d8ff68-73d4-4730-94a7-a6701bf03361 service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-vif-unplugged-a6126e35-cf95-47e8-8898-48be16256eb2 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.680s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Instance destroyed successfully.
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'resources' on Instance uuid d2e87c21-9cc6-43c2-a954-ba12eec2b0ee {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-838863928',display_name='tempest-TestVolumeBootPattern-volume-backed-server-838863928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-838863928',id=18,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXH1hacaiNwUz7bs583ZdGDHSuSJzfucLuooOvXqxTHWLJsV4OKL9ceiAqwA12a1KQGRDZxGfs8mpvLouxVtPAvmkXSulmvq1HCOW0c1wI1KWlPkp6ILOvW8d1qkPI9Iw==',key_name='tempest-keypair-1928239342',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-f976lf21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:43:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=d2e87c21-9cc6-43c2-a954-ba12eec2b0ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "a6126e35-cf95-47e8-8898-48be16256eb2", "address": "fa:16:3e:82:6f:be", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6126e35-cf", "ovs_interfaceid": "a6126e35-cf95-47e8-8898-48be16256eb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG os_vif [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6126e35-cf, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f4eb29f-4968-427d-b7ab-0d11d39bfe56) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:03 user nova-compute[75648]: INFO os_vif [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:6f:be,bridge_name='br-int',has_traffic_filtering=True,id=a6126e35-cf95-47e8-8898-48be16256eb2,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6126e35-cf')
Nov 15 05:48:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tEwJfbrz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:48:03 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[745870f1-e394-49b1-ba17-5426e72b2d03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:48:03 user nova-compute[75648]: No targets found.
Nov 15 05:48:03 user nova-compute[75648]: iSNS:
Nov 15 05:48:03 user nova-compute[75648]: No targets found.
Nov 15 05:48:03 user nova-compute[75648]: STATIC:
Nov 15 05:48:03 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f
Nov 15 05:48:03 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:48:03 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:48:03 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:48:03 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:48:03 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:48:03 user nova-compute[75648]: FIRMWARE:
Nov 15 05:48:03 user nova-compute[75648]: No targets found.
Nov 15 05:48:03 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:48:03 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:48:03 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b240c32-c403-420d-afcd-7a51d5a6d409]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e11c9fb-5a9f-4a6a-9aae-afb7e86ab558]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:48:03 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:48:03 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:48:03 user nova-compute[75648]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f (non-flash)
Nov 15 05:48:03 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8655f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f'): ({'sdf'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Removing single pathed devices sdf {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af5b751-de71-4221-a436-5c1faa1c7b7f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48e83a6-6fc0-4c91-8587-243399776e99]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flushing IO for device /dev/sdf {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b83bb-0dc0-445c-b6b7-dd3068c47ec0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.053s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04cc4eb-2448-40c2-b8b7-337f16ecedd6]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_c0c88c82', '/dev/disk/by-id/scsi-26236363166376238', '/dev/disk/by-id/scsi-1SCST_BIOc0c88c82-b661f7b8cc024c9d') {{(pid=87015) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[94483719-6d3c-4f60-949d-9773599df9f4]: (4, None) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90afd051-d658-422d-bca9-c4e1e8f782c0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc47fb7-52db-4064-bd69-82e5b3364e88]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260]
Nov 15 05:48:03 user nova-compute[75648]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f, portal: 172.16.0.220,3260] successful.
Nov 15 05:48:03 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66644bb-d41a-4882-8eda-fedf64fd4399]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== disconnect_volume: return (284ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:48:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Deleting instance files /opt/stack/data/nova/instances/d2e87c21-9cc6-43c2-a954-ba12eec2b0ee_del
Nov 15 05:48:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Deletion of /opt/stack/data/nova/instances/d2e87c21-9cc6-43c2-a954-ba12eec2b0ee_del complete
Nov 15 05:48:03 user nova-compute[75648]: INFO nova.compute.manager [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 05:48:03 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:48:03 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:04 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Took 0.71 seconds to deallocate network for instance.
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-7d43505e-13da-44ce-8b5d-5e2f01c805e7 req-fe5f3e04-8454-43eb-a134-0090ce958fab service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-vif-deleted-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:04 user nova-compute[75648]: INFO nova.compute.manager [req-7d43505e-13da-44ce-8b5d-5e2f01c805e7 req-fe5f3e04-8454-43eb-a134-0090ce958fab service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Neutron deleted interface a6126e35-cf95-47e8-8898-48be16256eb2; detaching it from the instance and deleting it from the info cache
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.network.neutron [req-7d43505e-13da-44ce-8b5d-5e2f01c805e7 req-fe5f3e04-8454-43eb-a134-0090ce958fab service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-7d43505e-13da-44ce-8b5d-5e2f01c805e7 req-fe5f3e04-8454-43eb-a134-0090ce958fab service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Detach interface failed, port_id=a6126e35-cf95-47e8-8898-48be16256eb2, reason: Instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-48680b0a-722a-4088-8f13-1e8cbbaaf8e1 req-ac9ebb1c-11bb-4eac-b910-11ea0aebeb4e service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received event network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-48680b0a-722a-4088-8f13-1e8cbbaaf8e1 req-ac9ebb1c-11bb-4eac-b910-11ea0aebeb4e service nova] Acquiring lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-48680b0a-722a-4088-8f13-1e8cbbaaf8e1 req-ac9ebb1c-11bb-4eac-b910-11ea0aebeb4e service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-48680b0a-722a-4088-8f13-1e8cbbaaf8e1 req-ac9ebb1c-11bb-4eac-b910-11ea0aebeb4e service nova] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-48680b0a-722a-4088-8f13-1e8cbbaaf8e1 req-ac9ebb1c-11bb-4eac-b910-11ea0aebeb4e service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] No waiting events found dispatching network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:04 user nova-compute[75648]: WARNING nova.compute.manager [req-48680b0a-722a-4088-8f13-1e8cbbaaf8e1 req-ac9ebb1c-11bb-4eac-b910-11ea0aebeb4e service nova] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Received unexpected event network-vif-plugged-a6126e35-cf95-47e8-8898-48be16256eb2 for instance with vm_state active and task_state deleting.
Nov 15 05:48:04 user nova-compute[75648]: INFO nova.compute.manager [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Took 0.84 seconds to detach 1 volumes for instance.
Nov 15 05:48:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: d2e87c21-9cc6-43c2-a954-ba12eec2b0ee] Deleting volume: 6cf5de9a-b6bf-4b9a-a262-2d6fbfd38b1f {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 05:48:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:05 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:48:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:48:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:05 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Deleted allocations for instance d2e87c21-9cc6-43c2-a954-ba12eec2b0ee
Nov 15 05:48:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ab9da2a1-e596-4d43-b028-aba0c47da37e tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "d2e87c21-9cc6-43c2-a954-ba12eec2b0ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.481s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing instance network info cache due to event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:48:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:48:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:48:06 user nova-compute[75648]: DEBUG nova.network.neutron [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:48:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updated VIF entry in instance network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:48:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f2f3af84-3984-4b67-8443-f7db8b2013b2 req-cb3fb60f-6cc3-4d81-97dc-09c27d27c97a service nova] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:48:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:08 user nova-compute[75648]: INFO nova.compute.manager [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Shelving
Nov 15 05:48:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-dd50e787-5e43-4262-9019-0683a100bb34 req-2020171b-7755-4481-a4ec-1f32bec6a36e service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-unplugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dd50e787-5e43-4262-9019-0683a100bb34 req-2020171b-7755-4481-a4ec-1f32bec6a36e service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dd50e787-5e43-4262-9019-0683a100bb34 req-2020171b-7755-4481-a4ec-1f32bec6a36e service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dd50e787-5e43-4262-9019-0683a100bb34 req-2020171b-7755-4481-a4ec-1f32bec6a36e service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-dd50e787-5e43-4262-9019-0683a100bb34 req-2020171b-7755-4481-a4ec-1f32bec6a36e service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-unplugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:08 user nova-compute[75648]: WARNING nova.compute.manager [req-dd50e787-5e43-4262-9019-0683a100bb34 req-2020171b-7755-4481-a4ec-1f32bec6a36e service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-unplugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state active and task_state shelving.
Nov 15 05:48:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance destroyed successfully.
Nov 15 05:48:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Beginning cold snapshot process
Nov 15 05:48:09 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:48:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk /opt/stack/data/nova/instances/snapshots/tmpm5pyloks/d3fff5d261dc419eb72f3b7b92b2e595 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk /opt/stack/data/nova/instances/snapshots/tmpm5pyloks/d3fff5d261dc419eb72f3b7b92b2e595" returned: 0 in 0.685s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:10 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Snapshot extracted, beginning image upload
Nov 15 05:48:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca6872fd-3804-4a0e-a095-595c9c16098c req-b961409d-5ab3-4dde-a4d0-799488116597 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca6872fd-3804-4a0e-a095-595c9c16098c req-b961409d-5ab3-4dde-a4d0-799488116597 service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca6872fd-3804-4a0e-a095-595c9c16098c req-b961409d-5ab3-4dde-a4d0-799488116597 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca6872fd-3804-4a0e-a095-595c9c16098c req-b961409d-5ab3-4dde-a4d0-799488116597 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca6872fd-3804-4a0e-a095-595c9c16098c req-b961409d-5ab3-4dde-a4d0-799488116597 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:10 user nova-compute[75648]: WARNING nova.compute.manager [req-ca6872fd-3804-4a0e-a095-595c9c16098c req-b961409d-5ab3-4dde-a4d0-799488116597 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state active and task_state shelving_image_uploading.
Nov 15 05:48:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Snapshot image upload complete
Nov 15 05:48:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:48:12 user nova-compute[75648]: INFO nova.compute.manager [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Shelve offloading
Nov 15 05:48:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance destroyed successfully.
Nov 15 05:48:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:48:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:48:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:48:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:48:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:48:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance destroyed successfully.
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'resources' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-927055105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-927055105',id=26,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpdO5eS2Z+vf+8bBm97dhKJcYhTJoR30Qg5PfCQugizmBWklnUSX6K5d26qsw9WzbMdMr5yVpg222SDTag479q5GOTgLDgwAKc4g90Kpv0XhdH/MbODNkNmBj7SONUfbg==',key_name='tempest-keypair-1905129680',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-i4r0o8lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member',shelved_at='2023-11-15T05:48:12.603174',shelved_host='user',shelved_image_id='b69c56d6-d55a-4e54-ad28-44f10c6f7d1b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=59e7c593-d1f7-4ebf-8fa8-b0ae91c96903,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG os_vif [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d14ba8c-00, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing instance network info cache due to event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39fde384-0c3c-4bcd-9adb-96410831e3f3) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:13 user nova-compute[75648]: INFO os_vif [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00')
Nov 15 05:48:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Deleting instance files /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903_del
Nov 15 05:48:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Deletion of /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903_del complete
Nov 15 05:48:13 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Deleted allocations for instance 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903
Nov 15 05:48:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'numa_topology' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.objects.base [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<59e7c593-d1f7-4ebf-8fa8-b0ae91c96903> lazy-loaded attributes: resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updated VIF entry in instance network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:48:13 user nova-compute[75648]: DEBUG nova.network.neutron [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-56db4437-d4aa-409e-bd56-1d977dbc909d req-43311163-1f4b-48ee-862a-cebd79a71e13 service nova] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:48:14 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:48:14 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:48:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5971c186-5070-46b2-9248-0781f9418d76 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.713s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "28e59728-466d-47b7-bdbb-96ce43e78280" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:16 user nova-compute[75648]: INFO nova.compute.manager [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Terminating instance
Nov 15 05:48:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-de012710-252a-4eb5-b125-e0bf1a259e2d req-266113b0-c335-48a0-af8f-835624462eeb service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-vif-unplugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de012710-252a-4eb5-b125-e0bf1a259e2d req-266113b0-c335-48a0-af8f-835624462eeb service nova] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de012710-252a-4eb5-b125-e0bf1a259e2d req-266113b0-c335-48a0-af8f-835624462eeb service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de012710-252a-4eb5-b125-e0bf1a259e2d req-266113b0-c335-48a0-af8f-835624462eeb service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-de012710-252a-4eb5-b125-e0bf1a259e2d req-266113b0-c335-48a0-af8f-835624462eeb service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] No waiting events found dispatching network-vif-unplugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-de012710-252a-4eb5-b125-e0bf1a259e2d req-266113b0-c335-48a0-af8f-835624462eeb service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-vif-unplugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:48:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Instance destroyed successfully.
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lazy-loading 'resources' on Instance uuid 28e59728-466d-47b7-bdbb-96ce43e78280 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-2122399907',display_name='tempest-VolumesActionsTest-instance-2122399907',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-2122399907',id=27,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d80c0c4fdf674d108496b63cd67ac2af',ramdisk_id='',reservation_id='r-sbr3tskr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1279806277',owner_user_name='tempest-VolumesActionsTest-1279806277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:46:32Z,user_data=None,user_id='233bc61e55934b57bf40084001640bb3',uuid=28e59728-466d-47b7-bdbb-96ce43e78280,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converting VIF {"id": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "address": "fa:16:3e:6d:dc:ac", "network": {"id": "0996ab67-7e55-4b94-b1d7-2a837b9b7c73", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1781467821-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d80c0c4fdf674d108496b63cd67ac2af", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cf61aa0-72", "ovs_interfaceid": "7cf61aa0-72ae-45b7-bce8-c56e7c967574", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG os_vif [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cf61aa0-72, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=558a22b7-3e4e-4498-96ef-56aaff1b5bba) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:17 user nova-compute[75648]: INFO os_vif [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6d:dc:ac,bridge_name='br-int',has_traffic_filtering=True,id=7cf61aa0-72ae-45b7-bce8-c56e7c967574,network=Network(0996ab67-7e55-4b94-b1d7-2a837b9b7c73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cf61aa0-72')
Nov 15 05:48:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Deleting instance files /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280_del
Nov 15 05:48:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Deletion of /opt/stack/data/nova/instances/28e59728-466d-47b7-bdbb-96ce43e78280_del complete
Nov 15 05:48:17 user nova-compute[75648]: INFO nova.compute.manager [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 05:48:17 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:17 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Took 0.42 seconds to deallocate network for instance.
Nov 15 05:48:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:18 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:48:18 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:48:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.347s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:18 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Deleted allocations for instance 28e59728-466d-47b7-bdbb-96ce43e78280
Nov 15 05:48:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d39e5d65-12ed-4929-84a1-ae2244725e9b tempest-VolumesActionsTest-1279806277 tempest-VolumesActionsTest-1279806277-project-member] Lock "28e59728-466d-47b7-bdbb-96ce43e78280" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.778s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] Acquiring lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] Lock "28e59728-466d-47b7-bdbb-96ce43e78280-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] No waiting events found dispatching network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:19 user nova-compute[75648]: WARNING nova.compute.manager [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received unexpected event network-vif-plugged-7cf61aa0-72ae-45b7-bce8-c56e7c967574 for instance with vm_state deleted and task_state None.
Nov 15 05:48:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-c2dd2c34-bcf3-40ac-98f9-7976034009e3 req-d75a525a-e19d-42d5-89b8-47d657b28ce7 service nova] [instance: 28e59728-466d-47b7-bdbb-96ce43e78280] Received event network-vif-deleted-7cf61aa0-72ae-45b7-bce8-c56e7c967574 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:28 user nova-compute[75648]: INFO nova.compute.manager [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Terminating instance
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-c6cd214f-5bf9-4ba5-a5c7-a5b7ca7c7ed9 req-1e9864d9-90ba-4434-99b3-b9e078a1628c service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-unplugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c6cd214f-5bf9-4ba5-a5c7-a5b7ca7c7ed9 req-1e9864d9-90ba-4434-99b3-b9e078a1628c service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c6cd214f-5bf9-4ba5-a5c7-a5b7ca7c7ed9 req-1e9864d9-90ba-4434-99b3-b9e078a1628c service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c6cd214f-5bf9-4ba5-a5c7-a5b7ca7c7ed9 req-1e9864d9-90ba-4434-99b3-b9e078a1628c service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-c6cd214f-5bf9-4ba5-a5c7-a5b7ca7c7ed9 req-1e9864d9-90ba-4434-99b3-b9e078a1628c service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-unplugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-c6cd214f-5bf9-4ba5-a5c7-a5b7ca7c7ed9 req-1e9864d9-90ba-4434-99b3-b9e078a1628c service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-unplugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:48:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Instance destroyed successfully.
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.objects.instance [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'resources' on Instance uuid 40448f79-0cbc-462a-be88-050f97128a07 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:43:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1312046518',display_name='tempest-TestMinimumBasicScenario-server-1312046518',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1312046518',id=19,image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEI1HOtaiCSAxyXom2SzZVLqtMwnYcysv+cn0KFAKSfgS4wkwlRPGpAVRAhOmmoubEgzy8jADoPs6wnsWI3faIzmsFLbexUqVTAcCmfzrz4KjqlU2YQNohn5aMa7T+PAQg==',key_name='tempest-TestMinimumBasicScenario-973469601',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ds02yl35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e0af5aca-7cfb-4309-89cd-1fb08884ac1f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:50Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=40448f79-0cbc-462a-be88-050f97128a07,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "address": "fa:16:3e:31:38:3b", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae26706e-32", "ovs_interfaceid": "ae26706e-3298-4eb3-a239-efe30a80ab1f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG os_vif [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae26706e-32, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1800dc06-53d0-47e7-9ed8-b205b24930d3) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:28 user nova-compute[75648]: INFO os_vif [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:38:3b,bridge_name='br-int',has_traffic_filtering=True,id=ae26706e-3298-4eb3-a239-efe30a80ab1f,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae26706e-32')
Nov 15 05:48:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Deleting instance files /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07_del
Nov 15 05:48:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Deletion of /opt/stack/data/nova/instances/40448f79-0cbc-462a-be88-050f97128a07_del complete
Nov 15 05:48:29 user nova-compute[75648]: INFO nova.compute.manager [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 05:48:29 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:48:29 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:48:29 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:48:29 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:29 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Took 0.87 seconds to deallocate network for instance.
Nov 15 05:48:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:30 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Deleted allocations for instance 40448f79-0cbc-462a-be88-050f97128a07
Nov 15 05:48:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f976c20-8254-4a94-9e8f-1dd9df42d5f1 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "40448f79-0cbc-462a-be88-050f97128a07" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.287s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] Acquiring lock "40448f79-0cbc-462a-be88-050f97128a07-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] Lock "40448f79-0cbc-462a-be88-050f97128a07-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] No waiting events found dispatching network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:30 user nova-compute[75648]: WARNING nova.compute.manager [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received unexpected event network-vif-plugged-ae26706e-3298-4eb3-a239-efe30a80ab1f for instance with vm_state deleted and task_state None.
Nov 15 05:48:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-78b84350-6ca0-4ebf-b2f5-6450e98275ea req-1a4e9737-1752-408e-af4b-3af12814df01 service nova] [instance: 40448f79-0cbc-462a-be88-050f97128a07] Received event network-vif-deleted-ae26706e-3298-4eb3-a239-efe30a80ab1f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:48:40 user nova-compute[75648]: INFO nova.compute.claims [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Claim successful on node user
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.417s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:48:40 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:48:40 user nova-compute[75648]: DEBUG nova.policy [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d61be40c2864afc99cd689efdb30308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06bd3ce1caf14075b2d936ac45b143f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:48:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Creating image(s)
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "/opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "/opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "/opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk 1073741824" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.358s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Successfully created port: 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Cannot resize image /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Ensure instance console log exists: /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Successfully updated port: 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-changed-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Refreshing instance network info cache due to event network-changed-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Instance network_info: |[{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Refreshing network info cache for port 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Start _get_guest_xml network_info=[{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:48:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:48:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-536338520',display_name='tempest-ServerActionsTestOtherA-server-536338520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-536338520',id=32,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-i11f5trz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=b955533a-d29e-4a8f-9c8e-7da7ae052eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.objects.instance [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'pci_devices' on Instance uuid b955533a-d29e-4a8f-9c8e-7da7ae052eae {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:48:42 user nova-compute[75648]:   <uuid>b955533a-d29e-4a8f-9c8e-7da7ae052eae</uuid>
Nov 15 05:48:42 user nova-compute[75648]:   <name>instance-00000020</name>
Nov 15 05:48:42 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:48:42 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:48:42 user nova-compute[75648]:   <metadata>
Nov 15 05:48:42 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:48:42 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:48:42 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherA-server-536338520</nova:name>
Nov 15 05:48:42 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:48:42</nova:creationTime>
Nov 15 05:48:42 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:48:42 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:48:42 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:48:42 user nova-compute[75648]:       <nova:owner>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:user uuid="5d61be40c2864afc99cd689efdb30308">tempest-ServerActionsTestOtherA-442850377-project-member</nova:user>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:project uuid="06bd3ce1caf14075b2d936ac45b143f5">tempest-ServerActionsTestOtherA-442850377</nova:project>
Nov 15 05:48:42 user nova-compute[75648]:       </nova:owner>
Nov 15 05:48:42 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:48:42 user nova-compute[75648]:       <nova:ports>
Nov 15 05:48:42 user nova-compute[75648]:         <nova:port uuid="7f136ac9-7a79-436e-a0a9-9bee09fcf9b1">
Nov 15 05:48:42 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:48:42 user nova-compute[75648]:         </nova:port>
Nov 15 05:48:42 user nova-compute[75648]:       </nova:ports>
Nov 15 05:48:42 user nova-compute[75648]:     </nova:instance>
Nov 15 05:48:42 user nova-compute[75648]:   </metadata>
Nov 15 05:48:42 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:48:42 user nova-compute[75648]:     <system>
Nov 15 05:48:42 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:48:42 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:48:42 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:48:42 user nova-compute[75648]:       <entry name="serial">b955533a-d29e-4a8f-9c8e-7da7ae052eae</entry>
Nov 15 05:48:42 user nova-compute[75648]:       <entry name="uuid">b955533a-d29e-4a8f-9c8e-7da7ae052eae</entry>
Nov 15 05:48:42 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:48:42 user nova-compute[75648]:     </system>
Nov 15 05:48:42 user nova-compute[75648]:   </sysinfo>
Nov 15 05:48:42 user nova-compute[75648]:   <os>
Nov 15 05:48:42 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:48:42 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:48:42 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:48:42 user nova-compute[75648]:   </os>
Nov 15 05:48:42 user nova-compute[75648]:   <features>
Nov 15 05:48:42 user nova-compute[75648]:     <acpi/>
Nov 15 05:48:42 user nova-compute[75648]:     <apic/>
Nov 15 05:48:42 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:48:42 user nova-compute[75648]:   </features>
Nov 15 05:48:42 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:48:42 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:48:42 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:48:42 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:48:42 user nova-compute[75648]:   </clock>
Nov 15 05:48:42 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:48:42 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:48:42 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:48:42 user nova-compute[75648]:   </cpu>
Nov 15 05:48:42 user nova-compute[75648]:   <devices>
Nov 15 05:48:42 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:48:42 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:48:42 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk"/>
Nov 15 05:48:42 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:48:42 user nova-compute[75648]:     </disk>
Nov 15 05:48:42 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:48:42 user nova-compute[75648]:       <mac address="fa:16:3e:b0:5b:fd"/>
Nov 15 05:48:42 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:48:42 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:48:42 user nova-compute[75648]:       <target dev="tap7f136ac9-7a"/>
Nov 15 05:48:42 user nova-compute[75648]:     </interface>
Nov 15 05:48:42 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:48:42 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/console.log" append="off"/>
Nov 15 05:48:42 user nova-compute[75648]:     </serial>
Nov 15 05:48:42 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:48:42 user nova-compute[75648]:     <video>
Nov 15 05:48:42 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:48:42 user nova-compute[75648]:     </video>
Nov 15 05:48:42 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:48:42 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:48:42 user nova-compute[75648]:     </rng>
Nov 15 05:48:42 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:48:42 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:48:42 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:48:42 user nova-compute[75648]:     </memballoon>
Nov 15 05:48:42 user nova-compute[75648]:   </devices>
Nov 15 05:48:42 user nova-compute[75648]: </domain>
Nov 15 05:48:42 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-536338520',display_name='tempest-ServerActionsTestOtherA-server-536338520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-536338520',id=32,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-i11f5trz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=b955533a-d29e-4a8f-9c8e-7da7ae052eae,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG os_vif [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64b00dd0-ac36-5abd-82cf-0cd890d0f516', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f136ac9-7a, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7f136ac9-7a, col_values=(('qos', UUID('c1272cee-648c-477f-b6cd-300fe561a971')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7f136ac9-7a, col_values=(('external_ids', {'iface-id': '7f136ac9-7a79-436e-a0a9-9bee09fcf9b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:5b:fd', 'vm-uuid': 'b955533a-d29e-4a8f-9c8e-7da7ae052eae'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:42 user nova-compute[75648]: INFO os_vif [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a')
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No VIF found with MAC fa:16:3e:b0:5b:fd, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:48:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated VIF entry in instance network info cache for port 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:48:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5c35c1bd-340e-49fc-8823-3d77690573d9 req-f0627669-295d-450d-92ce-86738de117d4 service nova] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-5f0d7efb-f3d6-4edb-8177-1f3f861fc639 req-edd4005d-a89c-4975-959b-3488654b077d service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5f0d7efb-f3d6-4edb-8177-1f3f861fc639 req-edd4005d-a89c-4975-959b-3488654b077d service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5f0d7efb-f3d6-4edb-8177-1f3f861fc639 req-edd4005d-a89c-4975-959b-3488654b077d service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5f0d7efb-f3d6-4edb-8177-1f3f861fc639 req-edd4005d-a89c-4975-959b-3488654b077d service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-5f0d7efb-f3d6-4edb-8177-1f3f861fc639 req-edd4005d-a89c-4975-959b-3488654b077d service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:44 user nova-compute[75648]: WARNING nova.compute.manager [req-5f0d7efb-f3d6-4edb-8177-1f3f861fc639 req-edd4005d-a89c-4975-959b-3488654b077d service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state building and task_state spawning.
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:48:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Instance spawned successfully.
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:48:46 user nova-compute[75648]: INFO nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Took 5.47 seconds to spawn the instance on the hypervisor.
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-ea7819b4-32fa-4a60-8574-856873e2aedd req-07e90bee-a269-4152-a4bf-3bf1a5fa820a service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ea7819b4-32fa-4a60-8574-856873e2aedd req-07e90bee-a269-4152-a4bf-3bf1a5fa820a service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ea7819b4-32fa-4a60-8574-856873e2aedd req-07e90bee-a269-4152-a4bf-3bf1a5fa820a service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ea7819b4-32fa-4a60-8574-856873e2aedd req-07e90bee-a269-4152-a4bf-3bf1a5fa820a service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-ea7819b4-32fa-4a60-8574-856873e2aedd req-07e90bee-a269-4152-a4bf-3bf1a5fa820a service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:48:46 user nova-compute[75648]: WARNING nova.compute.manager [req-ea7819b4-32fa-4a60-8574-856873e2aedd req-07e90bee-a269-4152-a4bf-3bf1a5fa820a service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state building and task_state spawning.
Nov 15 05:48:46 user nova-compute[75648]: INFO nova.compute.manager [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Took 6.21 seconds to build instance.
Nov 15 05:48:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0f5b2498-d160-4259-82de-2cf9b7a5a3e4 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.298s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:48:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:49:00 user nova-compute[75648]: INFO nova.compute.claims [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Claim successful on node user
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.525s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:00 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:49:00 user nova-compute[75648]: INFO nova.virt.block_device [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Booting with volume 82037273-a7aa-4a6e-870e-4e53bbd209fa at /dev/vda
Nov 15 05:49:00 user nova-compute[75648]: DEBUG nova.policy [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd4a8513df14fc7ab09905d24220ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea832b577b9445782f27e28b1023e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG os_brick.utils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a649d006-8a4e-45a1-839c-c01a8dedf650]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7363MB free_disk=25.09648895263672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[040cb6ad-e684-4437-a71d-f53a80b34dc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d56a30-6f0a-4783-9c5a-d3ce103d6b02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2557508-61a5-43f0-a618-6f71e39b701d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:01 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[11573f4a-4cb6-4e41-81ad-585e663610c7]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG os_brick.utils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== get_connector_properties: return (487ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updating existing volume attachment record: 700f235b-4d42-48ed-91bf-3a1ac3d72bb3 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 4981ff06-090a-40be-86d0-0fd12eb0cdd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance da4b88ea-7af5-4a88-819a-e0c62cbe338e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.network.neutron [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Successfully created port: c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:49:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Successfully updated port: c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquired lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-changed-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Refreshing instance network info cache due to event network-changed-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] Acquiring lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updating instance_info_cache with network_info: [{"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Releasing lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Instance network_info: |[{"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] Acquired lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Refreshing network info cache for port c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updated VIF entry in instance network info cache for port c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:49:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updating instance_info_cache with network_info: [{"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c08d8353-ccde-4720-8f4a-d5334c6d0a42 req-dfd5cdda-f43f-49d2-8454-936808a5e281 service nova] Releasing lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:04 user nova-compute[75648]: INFO nova.compute.manager [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Terminating instance
Nov 15 05:49:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-27433adb-0d34-4933-adc4-4d76fa31dd98 req-8d7fbb5b-c338-4826-869f-f930178236d5 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-vif-unplugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-27433adb-0d34-4933-adc4-4d76fa31dd98 req-8d7fbb5b-c338-4826-869f-f930178236d5 service nova] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-27433adb-0d34-4933-adc4-4d76fa31dd98 req-8d7fbb5b-c338-4826-869f-f930178236d5 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-27433adb-0d34-4933-adc4-4d76fa31dd98 req-8d7fbb5b-c338-4826-869f-f930178236d5 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-27433adb-0d34-4933-adc4-4d76fa31dd98 req-8d7fbb5b-c338-4826-869f-f930178236d5 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] No waiting events found dispatching network-vif-unplugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-27433adb-0d34-4933-adc4-4d76fa31dd98 req-8d7fbb5b-c338-4826-869f-f930178236d5 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-vif-unplugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Instance destroyed successfully.
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.objects.instance [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lazy-loading 'resources' on Instance uuid 4981ff06-090a-40be-86d0-0fd12eb0cdd7 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-234281588',display_name='tempest-ServersNegativeTestJSON-server-234281588',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-234281588',id=28,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:47:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27934c845b394f498de55243765a8f51',ramdisk_id='',reservation_id='r-wi13l7oy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1712721745',owner_user_name='tempest-ServersNegativeTestJSON-1712721745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:47:21Z,user_data=None,user_id='143f1f9cdbe649ad9827f6b2ea96caeb',uuid=4981ff06-090a-40be-86d0-0fd12eb0cdd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converting VIF {"id": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "address": "fa:16:3e:c4:a9:d1", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap27a4e331-76", "ovs_interfaceid": "27a4e331-76e8-42b8-bfb0-7aa3d17a177c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG os_vif [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap27a4e331-76, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3189ba3a-2658-4630-b709-dd329f95af5d) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:05 user nova-compute[75648]: INFO os_vif [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:a9:d1,bridge_name='br-int',has_traffic_filtering=True,id=27a4e331-76e8-42b8-bfb0-7aa3d17a177c,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap27a4e331-76')
Nov 15 05:49:05 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Deleting instance files /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7_del
Nov 15 05:49:05 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Deletion of /opt/stack/data/nova/instances/4981ff06-090a-40be-86d0-0fd12eb0cdd7_del complete
Nov 15 05:49:05 user nova-compute[75648]: INFO nova.compute.manager [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:05 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Took 0.42 seconds to deallocate network for instance.
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:49:05 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Creating image(s)
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Ensure instance console log exists: /opt/stack/data/nova/instances/da4b88ea-7af5-4a88-819a-e0c62cbe338e/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Start _get_guest_xml network_info=[{"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '700f235b-4d42-48ed-91bf-3a1ac3d72bb3', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da4b88ea-7af5-4a88-819a-e0c62cbe338e', 'attached_at': '', 'detached_at': '', 'volume_id': '82037273-a7aa-4a6e-870e-4e53bbd209fa', 'serial': '82037273-a7aa-4a6e-870e-4e53bbd209fa'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:49:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:05 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:05 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:05 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:49:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd81db88-1ec5-4241-a9e7-7d0a803f5a84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:49:06 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd4bc5a-365f-461c-bf98-ab4aa96134f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa] added
Nov 15 05:49:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4cac37-9135-4e50-be80-7c2f064f759c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[82195012-203b-4236-888e-19acff9429a9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcAkOBHq {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcAkOBHq" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf110ba8-c9ff-47ab-9556-a751d9bc5141]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DcAkOBHq'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Deleted allocations for instance 4981ff06-090a-40be-86d0-0fd12eb0cdd7
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ad1c0d-65cc-493b-9524-8ed0f3c80807]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b60b92f-15f1-48be-af2c-5e2134563e53]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-71602fcc-ac0f-43f3-b7bb-3cbbea1af74e tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.716s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0f9056-1e07-4553-a226-028cf45eaa78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]
Nov 15 05:49:06 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.
Nov 15 05:49:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[457f6c87-0762-4784-a449-f4e9c5109972]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef996a1-99c1-4e69-9bb9-87c4793beec0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:06 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:06 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adebf23-503c-42bf-8df0-bef4cb3b469d]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] Acquiring lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] Lock "4981ff06-090a-40be-86d0-0fd12eb0cdd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] No waiting events found dispatching network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:06 user nova-compute[75648]: WARNING nova.compute.manager [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received unexpected event network-vif-plugged-27a4e331-76e8-42b8-bfb0-7aa3d17a177c for instance with vm_state deleted and task_state None.
Nov 15 05:49:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-a114a302-50af-40dc-9c77-75ee489813fe req-85be091b-d192-4aa0-9bc7-08be90387016 service nova] [instance: 4981ff06-090a-40be-86d0-0fd12eb0cdd7] Received event network-vif-deleted-27a4e331-76e8-42b8-bfb0-7aa3d17a177c {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23633656666623030', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633656666623030', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1813895615',display_name='tempest-TestVolumeBootPattern-server-1813895615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1813895615',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-iq3swtep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:49:01Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=da4b88ea-7af5-4a88-819a-e0c62cbe338e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'pci_devices' on Instance uuid da4b88ea-7af5-4a88-819a-e0c62cbe338e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:49:07 user nova-compute[75648]:   <uuid>da4b88ea-7af5-4a88-819a-e0c62cbe338e</uuid>
Nov 15 05:49:07 user nova-compute[75648]:   <name>instance-00000021</name>
Nov 15 05:49:07 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:49:07 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:49:07 user nova-compute[75648]:   <metadata>
Nov 15 05:49:07 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:49:07 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:49:07 user nova-compute[75648]:       <nova:name>tempest-TestVolumeBootPattern-server-1813895615</nova:name>
Nov 15 05:49:07 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:49:05</nova:creationTime>
Nov 15 05:49:07 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:49:07 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:49:07 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:49:07 user nova-compute[75648]:       <nova:owner>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:user uuid="2fd4a8513df14fc7ab09905d24220ae1">tempest-TestVolumeBootPattern-522670763-project-member</nova:user>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:project uuid="bea832b577b9445782f27e28b1023e96">tempest-TestVolumeBootPattern-522670763</nova:project>
Nov 15 05:49:07 user nova-compute[75648]:       </nova:owner>
Nov 15 05:49:07 user nova-compute[75648]:       <nova:ports>
Nov 15 05:49:07 user nova-compute[75648]:         <nova:port uuid="c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d">
Nov 15 05:49:07 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 15 05:49:07 user nova-compute[75648]:         </nova:port>
Nov 15 05:49:07 user nova-compute[75648]:       </nova:ports>
Nov 15 05:49:07 user nova-compute[75648]:     </nova:instance>
Nov 15 05:49:07 user nova-compute[75648]:   </metadata>
Nov 15 05:49:07 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:49:07 user nova-compute[75648]:     <system>
Nov 15 05:49:07 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:49:07 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:49:07 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:49:07 user nova-compute[75648]:       <entry name="serial">da4b88ea-7af5-4a88-819a-e0c62cbe338e</entry>
Nov 15 05:49:07 user nova-compute[75648]:       <entry name="uuid">da4b88ea-7af5-4a88-819a-e0c62cbe338e</entry>
Nov 15 05:49:07 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:49:07 user nova-compute[75648]:     </system>
Nov 15 05:49:07 user nova-compute[75648]:   </sysinfo>
Nov 15 05:49:07 user nova-compute[75648]:   <os>
Nov 15 05:49:07 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:49:07 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:49:07 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:49:07 user nova-compute[75648]:   </os>
Nov 15 05:49:07 user nova-compute[75648]:   <features>
Nov 15 05:49:07 user nova-compute[75648]:     <acpi/>
Nov 15 05:49:07 user nova-compute[75648]:     <apic/>
Nov 15 05:49:07 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:49:07 user nova-compute[75648]:   </features>
Nov 15 05:49:07 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:49:07 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:49:07 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:49:07 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:49:07 user nova-compute[75648]:   </clock>
Nov 15 05:49:07 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:49:07 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:49:07 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:49:07 user nova-compute[75648]:   </cpu>
Nov 15 05:49:07 user nova-compute[75648]:   <devices>
Nov 15 05:49:07 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:49:07 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:49:07 user nova-compute[75648]:       <source dev="/dev/sdc"/>
Nov 15 05:49:07 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:49:07 user nova-compute[75648]:       <serial>82037273-a7aa-4a6e-870e-4e53bbd209fa</serial>
Nov 15 05:49:07 user nova-compute[75648]:     </disk>
Nov 15 05:49:07 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:49:07 user nova-compute[75648]:       <mac address="fa:16:3e:1f:09:8e"/>
Nov 15 05:49:07 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:49:07 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:49:07 user nova-compute[75648]:       <target dev="tapc3bbdf3a-a2"/>
Nov 15 05:49:07 user nova-compute[75648]:     </interface>
Nov 15 05:49:07 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:49:07 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/da4b88ea-7af5-4a88-819a-e0c62cbe338e/console.log" append="off"/>
Nov 15 05:49:07 user nova-compute[75648]:     </serial>
Nov 15 05:49:07 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:49:07 user nova-compute[75648]:     <video>
Nov 15 05:49:07 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:49:07 user nova-compute[75648]:     </video>
Nov 15 05:49:07 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:49:07 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:49:07 user nova-compute[75648]:     </rng>
Nov 15 05:49:07 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:49:07 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:49:07 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:49:07 user nova-compute[75648]:     </memballoon>
Nov 15 05:49:07 user nova-compute[75648]:   </devices>
Nov 15 05:49:07 user nova-compute[75648]: </domain>
Nov 15 05:49:07 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1813895615',display_name='tempest-TestVolumeBootPattern-server-1813895615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1813895615',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-iq3swtep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:49:01Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=da4b88ea-7af5-4a88-819a-e0c62cbe338e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG os_vif [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1a05fdb0-3c30-58a4-b89c-1ecb8b45911f', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3bbdf3a-a2, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3bbdf3a-a2, col_values=(('qos', UUID('e1dc8ce3-1359-4ced-a7ea-2a24c51a4716')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3bbdf3a-a2, col_values=(('external_ids', {'iface-id': 'c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:09:8e', 'vm-uuid': 'da4b88ea-7af5-4a88-819a-e0c62cbe338e'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:07 user nova-compute[75648]: INFO os_vif [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2')
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No VIF found with MAC fa:16:3e:1f:09:8e, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:49:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-df8460a9-f1a0-45bc-bc4d-5ba4a3d513fa req-9320b96c-fb1f-4a4f-acd7-1600af3ac1bf service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-df8460a9-f1a0-45bc-bc4d-5ba4a3d513fa req-9320b96c-fb1f-4a4f-acd7-1600af3ac1bf service nova] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-df8460a9-f1a0-45bc-bc4d-5ba4a3d513fa req-9320b96c-fb1f-4a4f-acd7-1600af3ac1bf service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-df8460a9-f1a0-45bc-bc4d-5ba4a3d513fa req-9320b96c-fb1f-4a4f-acd7-1600af3ac1bf service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-df8460a9-f1a0-45bc-bc4d-5ba4a3d513fa req-9320b96c-fb1f-4a4f-acd7-1600af3ac1bf service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] No waiting events found dispatching network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:08 user nova-compute[75648]: WARNING nova.compute.manager [req-df8460a9-f1a0-45bc-bc4d-5ba4a3d513fa req-9320b96c-fb1f-4a4f-acd7-1600af3ac1bf service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received unexpected event network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d for instance with vm_state building and task_state spawning.
Nov 15 05:49:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:49:10 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Instance spawned successfully.
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:10 user nova-compute[75648]: INFO nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Took 4.95 seconds to spawn the instance on the hypervisor.
Nov 15 05:49:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:49:10 user nova-compute[75648]: INFO nova.compute.manager [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Took 10.95 seconds to build instance.
Nov 15 05:49:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-44cd4651-3b00-417a-bd88-a16885055bac tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.076s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-db2968ca-18f6-45d9-ba70-61d99edd605a req-c7ac04b4-7f96-4b72-92f9-9f856dcb8ab0 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-db2968ca-18f6-45d9-ba70-61d99edd605a req-c7ac04b4-7f96-4b72-92f9-9f856dcb8ab0 service nova] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-db2968ca-18f6-45d9-ba70-61d99edd605a req-c7ac04b4-7f96-4b72-92f9-9f856dcb8ab0 service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-db2968ca-18f6-45d9-ba70-61d99edd605a req-c7ac04b4-7f96-4b72-92f9-9f856dcb8ab0 service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-db2968ca-18f6-45d9-ba70-61d99edd605a req-c7ac04b4-7f96-4b72-92f9-9f856dcb8ab0 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] No waiting events found dispatching network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:11 user nova-compute[75648]: WARNING nova.compute.manager [req-db2968ca-18f6-45d9-ba70-61d99edd605a req-c7ac04b4-7f96-4b72-92f9-9f856dcb8ab0 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received unexpected event network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d for instance with vm_state active and task_state None.
Nov 15 05:49:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-changed-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing instance network info cache due to event network-changed-3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG nova.network.neutron [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing network info cache for port 3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:11 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'flavor' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:12 user nova-compute[75648]: INFO nova.compute.manager [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Attaching volume ac36aea3-30c2-4cd1-a805-cc07d1c5e596 to /dev/vdb
Nov 15 05:49:12 user nova-compute[75648]: DEBUG nova.network.neutron [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updated VIF entry in instance network info cache for port 3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG nova.network.neutron [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ba1767a7-ccae-4c72-9f3c-9d5255b00341 req-1a385a85-3a21-4287-9a11-cc866a83f704 service nova] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG os_brick.utils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19dff2d-733c-413e-8981-b94df6562751]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2965437b-c1bc-4f38-93a8-7316ce96bd84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc47e68-bd04-4156-b8cb-cd2423b8e8fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af4357e-a0c7-43a2-bef6-023a7e17f44f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:12 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:49:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb2647-4325-4e49-a207-c1fba08f1b96]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG os_brick.utils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating existing volume attachment record: 8cd55d64-7a8d-4436-9ddb-759e6eb48700 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:49:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:49:15 user nova-compute[75648]: INFO nova.compute.manager [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] instance snapshotting
Nov 15 05:49:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Beginning live snapshot process
Nov 15 05:49:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.199s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json -f qcow2 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.240s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4pf13y00/65d568c3297e41a8b6e741cd16c06ebf.delta 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4pf13y00/65d568c3297e41a8b6e741cd16c06ebf.delta 1073741824" returned: 0 in 0.051s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:16 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 15 05:49:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75648) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 15 05:49:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 15 05:49:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4pf13y00/65d568c3297e41a8b6e741cd16c06ebf.delta /opt/stack/data/nova/instances/snapshots/tmp4pf13y00/65d568c3297e41a8b6e741cd16c06ebf {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHgQGsMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:17 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:17 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:17 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4929c5-03f2-4714-bbe2-ed5f7b1eb74d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:49:17 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1093f7b-c675-4b44-8a46-418637111904]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596] added
Nov 15 05:49:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5686fe-281d-4d6b-92e6-11ce5e2d70be]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62bdb37-0b44-499f-9a39-76d3df229c7d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHgQGsMU {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHgQGsMU" returned: 0 in 0.038s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[84882c91-34b1-476a-a095-f9adc1ca6b72]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WHgQGsMU'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.133s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[47889d57-2783-49e6-9841-7034b02d5698]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ff0435-8286-491f-b285-1d19df48fb94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f427002b-0dde-4c7e-b10b-f38c78c4707b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:17 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:17 user nova-compute[75648]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f427002b-0dde-4c7e-b10b-f38c78c4707b (non-flash)
Nov 15 05:49:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:17 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:17 user nova-compute[75648]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f427002b-0dde-4c7e-b10b-f38c78c4707b (non-flash)
Nov 15 05:49:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4pf13y00/65d568c3297e41a8b6e741cd16c06ebf.delta /opt/stack/data/nova/instances/snapshots/tmp4pf13y00/65d568c3297e41a8b6e741cd16c06ebf" returned: 0 in 0.535s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Snapshot extracted, beginning image upload
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --login" returned: 0 in 1.085s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d2925-f8be-4684-995f-628862c34612]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260]
Nov 15 05:49:18 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260] successful.
Nov 15 05:49:18 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[85666a93-b382-4034-aa0d-f431f6633d99]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab150cb-90eb-4b36-8b3b-a0bac12e93df]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f427002b-0dde-4c7e-b10b-f38c78c4707b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:19 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:19 user nova-compute[75648]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f427002b-0dde-4c7e-b10b-f38c78c4707b (non-flash)
Nov 15 05:49:19 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:19 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:19 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:19 user nova-compute[75648]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f427002b-0dde-4c7e-b10b-f38c78c4707b (non-flash)
Nov 15 05:49:19 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:19 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.488s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] HCTL ('36', '-', '-', 0) found on session 28 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4812c1f5-d23b-4cc4-9d6c-0f0e432c1fd0]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching for a device in session 28 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:49:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHgQGsMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.539s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] <== connect_volume: return (2542ms) {'type': 'block', 'scsi_wwn': '26532386536323865', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532386536323865', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'flavor' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:49:20 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:49:20 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:49:20 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:49:20 user nova-compute[75648]:   <serial>ac36aea3-30c2-4cd1-a805-cc07d1c5e596</serial>
Nov 15 05:49:20 user nova-compute[75648]: </disk>
Nov 15 05:49:20 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:39:80:ca, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:49:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2d3ea61d-f1da-46b6-a867-c24c20be526a tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.625s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:21 user nova-compute[75648]: INFO nova.compute.manager [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Rescuing
Nov 15 05:49:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:49:21 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Snapshot image upload complete
Nov 15 05:49:21 user nova-compute[75648]: INFO nova.compute.manager [None req-168ca8ab-e1a4-4b3f-be6f-3cddae84d201 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Took 6.33 seconds to snapshot the instance on the hypervisor.
Nov 15 05:49:21 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-f83e5284-c0a3-4e3e-8ff6-116165709883 req-3dadb854-321c-4452-b91a-6b874f63e74b service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f83e5284-c0a3-4e3e-8ff6-116165709883 req-3dadb854-321c-4452-b91a-6b874f63e74b service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f83e5284-c0a3-4e3e-8ff6-116165709883 req-3dadb854-321c-4452-b91a-6b874f63e74b service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f83e5284-c0a3-4e3e-8ff6-116165709883 req-3dadb854-321c-4452-b91a-6b874f63e74b service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-f83e5284-c0a3-4e3e-8ff6-116165709883 req-3dadb854-321c-4452-b91a-6b874f63e74b service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:22 user nova-compute[75648]: WARNING nova.compute.manager [req-f83e5284-c0a3-4e3e-8ff6-116165709883 req-3dadb854-321c-4452-b91a-6b874f63e74b service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state active and task_state rescuing.
Nov 15 05:49:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:22 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance destroyed successfully.
Nov 15 05:49:22 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Attempting rescue
Nov 15 05:49:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75648) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:49:22 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Creating image(s)
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue" returned: 0 in 0.058s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'migration_context' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<2fe5ece1-e20e-432d-9af8-976dc679dea5> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Start _get_guest_xml network_info=[{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:39:80:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'resources' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<2fe5ece1-e20e-432d-9af8-976dc679dea5> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'numa_topology' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<2fe5ece1-e20e-432d-9af8-976dc679dea5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:49:23 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:23 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<2fe5ece1-e20e-432d-9af8-976dc679dea5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-730897005',display_name='tempest-ServerRescueNegativeTestJSON-server-730897005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-730897005',id=29,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeNhKhjh86kt/gllTgX5pbI5QJTkapa+6W4wRQBQBUTTAwINIqglvygMmhbfqi6rGshznaBKU0r6XfR6gP05drx93phOsW24NEkoygCvnORjJoCAQ6Xsu7TVKnNRlrq1Q==',key_name='tempest-keypair-1093223766',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:47:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-tis05mag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:47:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=2fe5ece1-e20e-432d-9af8-976dc679dea5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:39:80:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "vif_mac": "fa:16:3e:39:80:ca"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.objects.base [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Object Instance<2fe5ece1-e20e-432d-9af8-976dc679dea5> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:49:23 user nova-compute[75648]:   <uuid>2fe5ece1-e20e-432d-9af8-976dc679dea5</uuid>
Nov 15 05:49:23 user nova-compute[75648]:   <name>instance-0000001d</name>
Nov 15 05:49:23 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:49:23 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:49:23 user nova-compute[75648]:   <metadata>
Nov 15 05:49:23 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:49:23 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:49:23 user nova-compute[75648]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-730897005</nova:name>
Nov 15 05:49:23 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:49:23</nova:creationTime>
Nov 15 05:49:23 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:49:23 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:49:23 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:49:23 user nova-compute[75648]:       <nova:owner>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:user uuid="e20600cd4fd148b1b871195e1e5397d7">tempest-ServerRescueNegativeTestJSON-1116175393-project-member</nova:user>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:project uuid="1ba132e2da344b8da008767a69ba0f3f">tempest-ServerRescueNegativeTestJSON-1116175393</nova:project>
Nov 15 05:49:23 user nova-compute[75648]:       </nova:owner>
Nov 15 05:49:23 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:49:23 user nova-compute[75648]:       <nova:ports>
Nov 15 05:49:23 user nova-compute[75648]:         <nova:port uuid="3a03d778-0782-478e-b330-30ad6415e732">
Nov 15 05:49:23 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 05:49:23 user nova-compute[75648]:         </nova:port>
Nov 15 05:49:23 user nova-compute[75648]:       </nova:ports>
Nov 15 05:49:23 user nova-compute[75648]:     </nova:instance>
Nov 15 05:49:23 user nova-compute[75648]:   </metadata>
Nov 15 05:49:23 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:49:23 user nova-compute[75648]:     <system>
Nov 15 05:49:23 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:49:23 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:49:23 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:49:23 user nova-compute[75648]:       <entry name="serial">2fe5ece1-e20e-432d-9af8-976dc679dea5</entry>
Nov 15 05:49:23 user nova-compute[75648]:       <entry name="uuid">2fe5ece1-e20e-432d-9af8-976dc679dea5</entry>
Nov 15 05:49:23 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:49:23 user nova-compute[75648]:     </system>
Nov 15 05:49:23 user nova-compute[75648]:   </sysinfo>
Nov 15 05:49:23 user nova-compute[75648]:   <os>
Nov 15 05:49:23 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:49:23 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:49:23 user nova-compute[75648]:   </os>
Nov 15 05:49:23 user nova-compute[75648]:   <features>
Nov 15 05:49:23 user nova-compute[75648]:     <acpi/>
Nov 15 05:49:23 user nova-compute[75648]:     <apic/>
Nov 15 05:49:23 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:49:23 user nova-compute[75648]:   </features>
Nov 15 05:49:23 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:49:23 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:49:23 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:49:23 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:49:23 user nova-compute[75648]:   </clock>
Nov 15 05:49:23 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:49:23 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:49:23 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:49:23 user nova-compute[75648]:   </cpu>
Nov 15 05:49:23 user nova-compute[75648]:   <devices>
Nov 15 05:49:23 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:49:23 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:49:23 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue"/>
Nov 15 05:49:23 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:49:23 user nova-compute[75648]:     </disk>
Nov 15 05:49:23 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:49:23 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:49:23 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk"/>
Nov 15 05:49:23 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:49:23 user nova-compute[75648]:     </disk>
Nov 15 05:49:23 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:49:23 user nova-compute[75648]:       <mac address="fa:16:3e:39:80:ca"/>
Nov 15 05:49:23 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:49:23 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:49:23 user nova-compute[75648]:       <target dev="tap3a03d778-07"/>
Nov 15 05:49:23 user nova-compute[75648]:     </interface>
Nov 15 05:49:23 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:49:23 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/console.log" append="off"/>
Nov 15 05:49:23 user nova-compute[75648]:     </serial>
Nov 15 05:49:23 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:49:23 user nova-compute[75648]:     <video>
Nov 15 05:49:23 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:49:23 user nova-compute[75648]:     </video>
Nov 15 05:49:23 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:49:23 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:49:23 user nova-compute[75648]:     </rng>
Nov 15 05:49:23 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:49:23 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:49:23 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:49:23 user nova-compute[75648]:     </memballoon>
Nov 15 05:49:23 user nova-compute[75648]:   </devices>
Nov 15 05:49:23 user nova-compute[75648]: </domain>
Nov 15 05:49:23 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:49:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance destroyed successfully.
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] No VIF found with MAC fa:16:3e:39:80:ca, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:23 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:49:23 user nova-compute[75648]: INFO nova.compute.claims [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Claim successful on node user
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:49:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.network.neutron [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.policy [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0aa1627a1bf4e0abc6618d6ecbe5944', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd3f0cb9d1048e899c02994b977bec3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:49:24 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:49:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-29783cb0-b8d2-4261-abb6-dbf5af7c4ab7 req-98554e59-4789-4473-b342-48c7e93c0eba service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29783cb0-b8d2-4261-abb6-dbf5af7c4ab7 req-98554e59-4789-4473-b342-48c7e93c0eba service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29783cb0-b8d2-4261-abb6-dbf5af7c4ab7 req-98554e59-4789-4473-b342-48c7e93c0eba service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-29783cb0-b8d2-4261-abb6-dbf5af7c4ab7 req-98554e59-4789-4473-b342-48c7e93c0eba service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-29783cb0-b8d2-4261-abb6-dbf5af7c4ab7 req-98554e59-4789-4473-b342-48c7e93c0eba service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:25 user nova-compute[75648]: WARNING nova.compute.manager [req-29783cb0-b8d2-4261-abb6-dbf5af7c4ab7 req-98554e59-4789-4473-b342-48c7e93c0eba service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state active and task_state rescuing.
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:49:25 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Creating image(s)
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "/opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "/opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "/opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Successfully created port: 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.part --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.virt.images [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] 1120b825-9a59-4af3-a4d5-4b27ebd58b97 was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:49:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.part /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.part /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.converted" returned: 0 in 0.964s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Successfully updated port: 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:27 user nova-compute[75648]: WARNING nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state active and task_state rescuing.
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:27 user nova-compute[75648]: WARNING nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state active and task_state rescuing.
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing instance network info cache due to event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57.converted --force-share --output=json" returned: 0 in 0.286s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.091s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 --force-share --output=json" returned: 0 in 0.269s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 --force-share --output=json" returned: 0 in 0.208s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57,backing_fmt=raw /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance network_info: |[{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG nova.network.neutron [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:49:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57,backing_fmt=raw /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk 1073741824" returned: 0 in 0.337s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.549s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 --force-share --output=json" returned: 0 in 0.367s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Cannot resize image /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Ensure instance console log exists: /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Start _get_guest_xml network_info=[{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:49:20Z,direct_url=<?>,disk_format='qcow2',id=1120b825-9a59-4af3-a4d5-4b27ebd58b97,min_disk=0,min_ram=0,name='tempest-scenario-img--1888475398',owner='abd3f0cb9d1048e899c02994b977bec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:49:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '1120b825-9a59-4af3-a4d5-4b27ebd58b97'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:49:28 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:28 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updated VIF entry in instance network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:49:20Z,direct_url=<?>,disk_format='qcow2',id=1120b825-9a59-4af3-a4d5-4b27ebd58b97,min_disk=0,min_ram=0,name='tempest-scenario-img--1888475398',owner='abd3f0cb9d1048e899c02994b977bec3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:49:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2017508956',display_name='tempest-TestMinimumBasicScenario-server-2017508956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2017508956',id=34,image_ref='1120b825-9a59-4af3-a4d5-4b27ebd58b97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiDyPWIfAXks04V0IoUDVOhL6vJWjRzm5Z0ABHll8OxI5F/RtytWnFIq9hknNtzwBkNrE0+H6kEj5W1W+qNAhosRAQoquL4aEfFt9PqzL93mukg4ddeUor6ItV1S7/mMA==',key_name='tempest-TestMinimumBasicScenario-589473324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ji8sfzk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1120b825-9a59-4af3-a4d5-4b27ebd58b97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:49:25Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=878ae6df-048e-4181-895e-64ad390935dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.objects.instance [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'pci_devices' on Instance uuid 878ae6df-048e-4181-895e-64ad390935dc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5644c92c-9ef4-4a78-b2b0-03a9654d8a44 req-ccddc5f0-7308-42bd-8ae9-dbe281fe4806 service nova] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:49:28 user nova-compute[75648]:   <uuid>878ae6df-048e-4181-895e-64ad390935dc</uuid>
Nov 15 05:49:28 user nova-compute[75648]:   <name>instance-00000022</name>
Nov 15 05:49:28 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:49:28 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:49:28 user nova-compute[75648]:   <metadata>
Nov 15 05:49:28 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:49:28 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:49:28 user nova-compute[75648]:       <nova:name>tempest-TestMinimumBasicScenario-server-2017508956</nova:name>
Nov 15 05:49:28 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:49:28</nova:creationTime>
Nov 15 05:49:28 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:49:28 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:49:28 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:49:28 user nova-compute[75648]:       <nova:owner>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:user uuid="b0aa1627a1bf4e0abc6618d6ecbe5944">tempest-TestMinimumBasicScenario-623726925-project-member</nova:user>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:project uuid="abd3f0cb9d1048e899c02994b977bec3">tempest-TestMinimumBasicScenario-623726925</nova:project>
Nov 15 05:49:28 user nova-compute[75648]:       </nova:owner>
Nov 15 05:49:28 user nova-compute[75648]:       <nova:root type="image" uuid="1120b825-9a59-4af3-a4d5-4b27ebd58b97"/>
Nov 15 05:49:28 user nova-compute[75648]:       <nova:ports>
Nov 15 05:49:28 user nova-compute[75648]:         <nova:port uuid="61cc90ce-a6c4-41b5-869b-222e051f6c36">
Nov 15 05:49:28 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 05:49:28 user nova-compute[75648]:         </nova:port>
Nov 15 05:49:28 user nova-compute[75648]:       </nova:ports>
Nov 15 05:49:28 user nova-compute[75648]:     </nova:instance>
Nov 15 05:49:28 user nova-compute[75648]:   </metadata>
Nov 15 05:49:28 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:49:28 user nova-compute[75648]:     <system>
Nov 15 05:49:28 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:49:28 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:49:28 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:49:28 user nova-compute[75648]:       <entry name="serial">878ae6df-048e-4181-895e-64ad390935dc</entry>
Nov 15 05:49:28 user nova-compute[75648]:       <entry name="uuid">878ae6df-048e-4181-895e-64ad390935dc</entry>
Nov 15 05:49:28 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:49:28 user nova-compute[75648]:     </system>
Nov 15 05:49:28 user nova-compute[75648]:   </sysinfo>
Nov 15 05:49:28 user nova-compute[75648]:   <os>
Nov 15 05:49:28 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:49:28 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:49:28 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:49:28 user nova-compute[75648]:   </os>
Nov 15 05:49:28 user nova-compute[75648]:   <features>
Nov 15 05:49:28 user nova-compute[75648]:     <acpi/>
Nov 15 05:49:28 user nova-compute[75648]:     <apic/>
Nov 15 05:49:28 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:49:28 user nova-compute[75648]:   </features>
Nov 15 05:49:28 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:49:28 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:49:28 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:49:28 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:49:28 user nova-compute[75648]:   </clock>
Nov 15 05:49:28 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:49:28 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:49:28 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:49:28 user nova-compute[75648]:   </cpu>
Nov 15 05:49:28 user nova-compute[75648]:   <devices>
Nov 15 05:49:28 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:49:28 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:49:28 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk"/>
Nov 15 05:49:28 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:49:28 user nova-compute[75648]:     </disk>
Nov 15 05:49:28 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:49:28 user nova-compute[75648]:       <mac address="fa:16:3e:39:f8:f0"/>
Nov 15 05:49:28 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:49:28 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:49:28 user nova-compute[75648]:       <target dev="tap61cc90ce-a6"/>
Nov 15 05:49:28 user nova-compute[75648]:     </interface>
Nov 15 05:49:28 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:49:28 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/console.log" append="off"/>
Nov 15 05:49:28 user nova-compute[75648]:     </serial>
Nov 15 05:49:28 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:49:28 user nova-compute[75648]:     <video>
Nov 15 05:49:28 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:49:28 user nova-compute[75648]:     </video>
Nov 15 05:49:28 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:49:28 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:49:28 user nova-compute[75648]:     </rng>
Nov 15 05:49:28 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:49:28 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:49:28 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:49:28 user nova-compute[75648]:     </memballoon>
Nov 15 05:49:28 user nova-compute[75648]:   </devices>
Nov 15 05:49:28 user nova-compute[75648]: </domain>
Nov 15 05:49:28 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2017508956',display_name='tempest-TestMinimumBasicScenario-server-2017508956',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2017508956',id=34,image_ref='1120b825-9a59-4af3-a4d5-4b27ebd58b97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiDyPWIfAXks04V0IoUDVOhL6vJWjRzm5Z0ABHll8OxI5F/RtytWnFIq9hknNtzwBkNrE0+H6kEj5W1W+qNAhosRAQoquL4aEfFt9PqzL93mukg4ddeUor6ItV1S7/mMA==',key_name='tempest-TestMinimumBasicScenario-589473324',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ji8sfzk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1120b825-9a59-4af3-a4d5-4b27ebd58b97',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:49:25Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=878ae6df-048e-4181-895e-64ad390935dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG os_vif [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee79f207-4ca6-5e0f-bec7-7a39618a8bab', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61cc90ce-a6, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61cc90ce-a6, col_values=(('qos', UUID('b814afb9-f428-41b2-a9db-1a89f490b89d')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61cc90ce-a6, col_values=(('external_ids', {'iface-id': '61cc90ce-a6c4-41b5-869b-222e051f6c36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:f8:f0', 'vm-uuid': '878ae6df-048e-4181-895e-64ad390935dc'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:49:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:28 user nova-compute[75648]: INFO os_vif [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6')
Nov 15 05:49:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No VIF found with MAC fa:16:3e:39:f8:f0, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:49:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a4df3c96-6005-4a4b-887c-605499401e9f tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:49:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-changed-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Refreshing instance network info cache due to event network-changed-b14524ce-ee45-46c9-bedb-5bebb63aa2d1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:49:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] Acquiring lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] Acquired lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Refreshing network info cache for port b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:49:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:31 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'flavor' on Instance uuid c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:31 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Ignoring supplied device name: /dev/vdb
Nov 15 05:49:31 user nova-compute[75648]: DEBUG nova.network.neutron [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updated VIF entry in instance network info cache for port b14524ce-ee45-46c9-bedb-5bebb63aa2d1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:49:31 user nova-compute[75648]: DEBUG nova.network.neutron [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updating instance_info_cache with network_info: [{"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.845s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a51e2444-d7b7-46ca-b9ae-8e0ed27557db req-3a4beac1-1abe-4027-af6a-f90ac694c8a3 service nova] Releasing lock "refresh_cache-c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-9d01cb84-9b0f-4f43-8421-08fb29b2f791 req-4d5f0206-1aa7-4802-ae70-2ae8010e7237 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9d01cb84-9b0f-4f43-8421-08fb29b2f791 req-4d5f0206-1aa7-4802-ae70-2ae8010e7237 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9d01cb84-9b0f-4f43-8421-08fb29b2f791 req-4d5f0206-1aa7-4802-ae70-2ae8010e7237 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9d01cb84-9b0f-4f43-8421-08fb29b2f791 req-4d5f0206-1aa7-4802-ae70-2ae8010e7237 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-9d01cb84-9b0f-4f43-8421-08fb29b2f791 req-4d5f0206-1aa7-4802-ae70-2ae8010e7237 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:32 user nova-compute[75648]: WARNING nova.compute.manager [req-9d01cb84-9b0f-4f43-8421-08fb29b2f791 req-4d5f0206-1aa7-4802-ae70-2ae8010e7237 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state building and task_state spawning.
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:32 user nova-compute[75648]: INFO nova.compute.manager [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Attaching volume 4598b1aa-637e-46b9-b67b-e529001aecf7 to /dev/vdb
Nov 15 05:49:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG os_brick.utils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fe78cc-5a4c-40a2-a566-4290803b5155]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e650f5c-3c5d-4547-89e6-ff69ab61a607]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f67c33b-8440-4e5b-806d-85087118e6ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a7a4ac-836f-4b5f-94e9-f57433302800]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:33 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:49:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d105cd1-bf85-44f6-a2d6-48161547a7d3]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG os_brick.utils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== get_connector_properties: return (172ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updating existing volume attachment record: 5e0d0ebd-48aa-4357-9407-c8a8290e24b0 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:49:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-48892639-b9bb-40b5-aaf7-a148bf324b66 req-bb9e5820-a14e-47af-b77a-1b3399141515 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:49:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-48892639-b9bb-40b5-aaf7-a148bf324b66 req-bb9e5820-a14e-47af-b77a-1b3399141515 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-48892639-b9bb-40b5-aaf7-a148bf324b66 req-bb9e5820-a14e-47af-b77a-1b3399141515 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-48892639-b9bb-40b5-aaf7-a148bf324b66 req-bb9e5820-a14e-47af-b77a-1b3399141515 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-48892639-b9bb-40b5-aaf7-a148bf324b66 req-bb9e5820-a14e-47af-b77a-1b3399141515 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:49:34 user nova-compute[75648]: WARNING nova.compute.manager [req-48892639-b9bb-40b5-aaf7-a148bf324b66 req-bb9e5820-a14e-47af-b77a-1b3399141515 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state building and task_state spawning.
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:49:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance spawned successfully.
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:49:35 user nova-compute[75648]: INFO nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Took 9.98 seconds to spawn the instance on the hypervisor.
Nov 15 05:49:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:49:35 user nova-compute[75648]: INFO nova.compute.manager [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Took 11.66 seconds to build instance.
Nov 15 05:49:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-82462d3a-348c-4d4e-818c-543149337e01 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.770s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdcIaPXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:38 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.012s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:38 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:38 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[03288385-bed5-495f-bef1-2ef544083115]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:49:38 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[67001427-e734-42f5-9ef8-3b7a68154560]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7] added
Nov 15 05:49:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc86845c-e26f-4308-bf80-42d2dff84dd0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1da90f5-36e6-43aa-ac32-6b7b1a6a5e4d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdcIaPXG {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdcIaPXG" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[670d98db-0f26-47c6-9b52-5c308e323ae8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdcIaPXG'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fca816d-3a7b-4713-9d17-4e97ef49c92c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc98402-d0fc-415c-99c1-614dfd50ed69]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[61560f7f-88b2-4283-9f4b-753a82f0583f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260]
Nov 15 05:49:38 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260] successful.
Nov 15 05:49:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6922e875-b996-4531-8b8c-cfa20818e80b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b4dd6e-d9d8-4053-a247-60ba2f5cc1b1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:49:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:38 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:49:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24d8238-79ee-44b0-aec3-10ce44ce14e0]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdcIaPXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:49:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26161643531623432', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161643531623432', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:49:39 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'flavor' on Instance uuid c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:49:39 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:49:39 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:49:39 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:49:39 user nova-compute[75648]:   <serial>4598b1aa-637e-46b9-b67b-e529001aecf7</serial>
Nov 15 05:49:39 user nova-compute[75648]: </disk>
Nov 15 05:49:39 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:49:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No VIF found with MAC fa:16:3e:67:6d:e7, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:49:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2b03cde8-86ed-4092-a36c-968fe6663e72 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.572s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:50 user nova-compute[75648]: INFO nova.compute.manager [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Detaching volume 4598b1aa-637e-46b9-b67b-e529001aecf7
Nov 15 05:49:51 user nova-compute[75648]: INFO nova.virt.block_device [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Attempting to driver detach volume 4598b1aa-637e-46b9-b67b-e529001aecf7 from mountpoint /dev/vdb
Nov 15 05:49:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Attempting to detach device vdb from instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:49:51 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:49:51 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:49:51 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:49:51 user nova-compute[75648]:   <serial>4598b1aa-637e-46b9-b67b-e529001aecf7</serial>
Nov 15 05:49:51 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:49:51 user nova-compute[75648]: </disk>
Nov 15 05:49:51 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:49:51 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully detached device vdb from instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e from the persistent domain config.
Nov 15 05:49:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:49:51 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:49:51 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:49:51 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:49:51 user nova-compute[75648]:   <serial>4598b1aa-637e-46b9-b67b-e529001aecf7</serial>
Nov 15 05:49:51 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:49:51 user nova-compute[75648]: </disk>
Nov 15 05:49:51 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG nova.objects.instance [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'flavor' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:51 user nova-compute[75648]: INFO nova.compute.manager [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Attaching volume 50879f6c-d4f9-45d9-b06a-e176925f814d to /dev/vdb
Nov 15 05:49:52 user nova-compute[75648]: DEBUG os_brick.utils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7360e67-20ce-47d5-8326-6f9a97d957ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[845b9135-7d0a-4977-8169-7c0d95e592ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6eacb8-5900-4d57-b848-df1d11e03125]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47e546e-f710-4c7e-8b87-9c0f356d5db9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:49:52 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e514d7-a62d-4f87-99b0-05a95e03ca18]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG os_brick.utils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating existing volume attachment record: b32f5d69-d432-46fe-9a67-f9e374eb8808 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:49:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:49:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:49:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:49:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updating instance_info_cache with network_info: [{"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:49:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-0aea1f03-161c-4b04-bee9-e0453ac6a110" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:49:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:49:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:56 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:49:57 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:57 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:49:57 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d4263a-cc75-4b2b-9a4b-d4bd6bfc7853]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:49:57 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9503539-502d-4ee6-bc06-76c1a711b89a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d] added
Nov 15 05:49:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a62902-894b-4a60-bd14-39646deb279e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0094de4c-0feb-46da-83d6-27c6e1e9a6ab]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUVYEDj {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUVYEDj" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8823df0d-2987-4e6b-956f-f1b532565a40]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTUVYEDj'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6684cb80-d597-42a2-9d20-c78278367b48]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc620b-0cba-44a3-9df1-a2f25684b64a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0331bd-50b1-4727-b29d-d85ec84760bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]
Nov 15 05:49:57 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.
Nov 15 05:49:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd9eb5a-f2dc-4bff-bbeb-eb426d71bcd8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f33b92-b647-4349-8743-a7805d6c83f4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:49:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:49:57 user nova-compute[75648]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:49:57 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] HCTL ('37', '-', '-', 0) found on session 30 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[102de759-df86-4ea1-8b07-ba6a4cfad9a2]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching for a device in session 30 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '23330616236353531', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330616236353531', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.objects.instance [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'flavor' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:49:58 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:49:58 user nova-compute[75648]:   <source dev="/dev/sdf"/>
Nov 15 05:49:58 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:49:58 user nova-compute[75648]:   <serial>50879f6c-d4f9-45d9-b06a-e176925f814d</serial>
Nov 15 05:49:58 user nova-compute[75648]: </disk>
Nov 15 05:49:58 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No VIF found with MAC fa:16:3e:9a:5e:31, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:49:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-37b1ae5c-92ed-472f-b8ce-9a02ae440ebe tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.145s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:49:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:01 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7282MB free_disk=24.986186981201172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:01 user nova-compute[75648]: INFO nova.compute.manager [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Unshelving
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Stashing vm_state: active {{(pid=75648) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 05:50:01 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating resource usage from migration 877eca90-5a78-43e0-9769-13c6076c1203
Nov 15 05:50:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance da4b88ea-7af5-4a88-819a-e0c62cbe338e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 878ae6df-048e-4181-895e-64ad390935dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Migration 877eca90-5a78-43e0-9769-13c6076c1203 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 05:50:01 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.807s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.616s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'pci_requests' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'numa_topology' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:50:02 user nova-compute[75648]: INFO nova.compute.claims [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Claim successful on node user
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.140s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:02 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:50:02 user nova-compute[75648]: INFO nova.compute.claims [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Claim successful on node user
Nov 15 05:50:02 user nova-compute[75648]: INFO nova.network.neutron [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating port 7d14ba8c-00f2-4218-affc-cf872dda8026 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 05:50:02 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating resource usage from migration 877eca90-5a78-43e0-9769-13c6076c1203
Nov 15 05:50:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.492s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:03 user nova-compute[75648]: INFO nova.compute.manager [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Migrating
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:03 user nova-compute[75648]: INFO nova.compute.rpcapi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing instance network info cache due to event network-changed-7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] Acquiring lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:50:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Creating image(s)
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] Acquired lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Refreshing network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Starting migrate_disk_and_power_off {{(pid=75648) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG nova.objects.base [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<59e7c593-d1f7-4ebf-8fa8-b0ae91c96903> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "729c557b01c39123e38323583d78469c87351173" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "729c557b01c39123e38323583d78469c87351173" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance destroyed successfully.
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e72138-d2, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=818b4629-f624-4605-9cc5-ae1155565806) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:05 user nova-compute[75648]: INFO os_vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2')
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:50:05 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5f1760-e012-454f-ac0c-615fdffa4fb3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:50:05 user nova-compute[75648]: No targets found.
Nov 15 05:50:05 user nova-compute[75648]: iSNS:
Nov 15 05:50:05 user nova-compute[75648]: No targets found.
Nov 15 05:50:05 user nova-compute[75648]: STATIC:
Nov 15 05:50:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:50:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:50:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:50:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7
Nov 15 05:50:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:50:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:05 user nova-compute[75648]: FIRMWARE:
Nov 15 05:50:05 user nova-compute[75648]: No targets found.
Nov 15 05:50:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:50:05 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:50:05 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeee6466-a50f-43e1-8223-a2bd86c36103]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.part --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.virt.images [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] b69c56d6-d55a-4e54-ad28-44f10c6f7d1b was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.part /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb83aa9-171b-4a8b-b5c1-3cadfa974804]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:50:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:50:05 user nova-compute[75648]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:50:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ce830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d'): ({'sdf'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Removing single pathed devices sdf {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d411b88-0b2b-4d3b-9562-55f8aeabb521]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fc4c4c-79f1-4c59-a344-3a44582ed387]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flushing IO for device /dev/sdf {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128a566-e9f8-496a-a048-c1406d4c2341]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updated VIF entry in instance network info cache for port 7d14ba8c-00f2-4218-affc-cf872dda8026. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-09c3bd9a-f677-4170-be5f-8b18c3691d28 req-a03c4d1b-b58d-4e36-ad1b-e9495cf54c3d service nova] Releasing lock "refresh_cache-59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.065s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc83f061-4da8-48a9-b4bb-da30bd7ae192]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d9a85d-e8ec-4a5e-af73-4efe0e356ddd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --logout" returned: 0 in 0.091s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[da184550-2053-4a8f-9bdc-01bd53a9170e]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]
Nov 15 05:50:05 user nova-compute[75648]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.
Nov 15 05:50:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:05 user nova-compute[75648]: WARNING nova.compute.manager [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state active and task_state resize_migrating.
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:05 user nova-compute[75648]: WARNING nova.compute.manager [req-a81425b3-9431-4aaa-8c60-0099be795787 req-dd4baa95-e9b1-40ab-bedc-e4fe20957339 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state active and task_state resize_migrating.
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed0606-bac6-4c52-8991-180cbad94759]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== disconnect_volume: return (418ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.part /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.converted" returned: 0 in 0.442s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173.converted --force-share --output=json" returned: 0 in 0.168s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "729c557b01c39123e38323583d78469c87351173" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.970s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb_resize/disk /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "729c557b01c39123e38323583d78469c87351173" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "729c557b01c39123e38323583d78469c87351173" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173,backing_fmt=raw /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173,backing_fmt=raw /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk 1073741824" returned: 0 in 0.048s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "729c557b01c39123e38323583d78469c87351173" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'migration_context' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG nova.objects.base [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<59e7c593-d1f7-4ebf-8fa8-b0ae91c96903> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:50:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Rebasing disk image.
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "cp -r /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb_resize/disk /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk" returned: 0 in 0.529s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb_resize/disk.info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk.info {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "cp -r /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb_resize/disk.info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk.info" returned: 0 in 0.034s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a -F raw /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Port c5e72138-d273-4bb1-ac14-8e5f88e04114 binding to destination host user is already ACTIVE {{(pid=75648) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_brick.utils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1debdde-a637-46e1-8a5c-037cb155e91a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78162d8-392f-41cb-93ed-a373a7ed64c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9147129-eb19-43c6-a433-b09c985ec124]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d8da3a-e020-42ac-8769-468118890743]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:50:08 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd811c70-9fc7-4fa2-bb92-8dd84cfd599b]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_brick.utils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a -F raw /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk" returned: 0 in 2.080s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Ensure instance console log exists: /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Start _get_guest_xml network_info=[{"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='878cbeeed645b3c18a7c8bae8af92519',container_format='bare',created_at=2023-11-15T05:48:08Z,direct_url=<?>,disk_format='qcow2',id=b69c56d6-d55a-4e54-ad28-44f10c6f7d1b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-927055105-shelved',owner='a08f06fc4de745b589b4db3c2147e43d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T05:48:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:50:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='878cbeeed645b3c18a7c8bae8af92519',container_format='bare',created_at=2023-11-15T05:48:08Z,direct_url=<?>,disk_format='qcow2',id=b69c56d6-d55a-4e54-ad28-44f10c6f7d1b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-927055105-shelved',owner='a08f06fc4de745b589b4db3c2147e43d',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-15T05:48:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.objects.base [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<59e7c593-d1f7-4ebf-8fa8-b0ae91c96903> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-927055105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-927055105',id=26,image_ref='b69c56d6-d55a-4e54-ad28-44f10c6f7d1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1905129680',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-i4r0o8lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member',shelved_at='2023-11-15T05:48:12.603174',shelved_host='user',shelved_image_id='b69c56d6-d55a-4e54-ad28-44f10c6f7d1b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=59e7c593-d1f7-4ebf-8fa8-b0ae91c96903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'pci_devices' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.objects.base [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Object Instance<59e7c593-d1f7-4ebf-8fa8-b0ae91c96903> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:50:08 user nova-compute[75648]:   <uuid>59e7c593-d1f7-4ebf-8fa8-b0ae91c96903</uuid>
Nov 15 05:50:08 user nova-compute[75648]:   <name>instance-0000001a</name>
Nov 15 05:50:08 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:50:08 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:50:08 user nova-compute[75648]:   <metadata>
Nov 15 05:50:08 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:50:08 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:50:08 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-927055105</nova:name>
Nov 15 05:50:08 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:50:08</nova:creationTime>
Nov 15 05:50:08 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:50:08 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:50:08 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:50:08 user nova-compute[75648]:       <nova:owner>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:user uuid="8bd09324c4634b8b820c49b51752a688">tempest-AttachVolumeShelveTestJSON-1500760960-project-member</nova:user>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:project uuid="a08f06fc4de745b589b4db3c2147e43d">tempest-AttachVolumeShelveTestJSON-1500760960</nova:project>
Nov 15 05:50:08 user nova-compute[75648]:       </nova:owner>
Nov 15 05:50:08 user nova-compute[75648]:       <nova:root type="image" uuid="b69c56d6-d55a-4e54-ad28-44f10c6f7d1b"/>
Nov 15 05:50:08 user nova-compute[75648]:       <nova:ports>
Nov 15 05:50:08 user nova-compute[75648]:         <nova:port uuid="7d14ba8c-00f2-4218-affc-cf872dda8026">
Nov 15 05:50:08 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:50:08 user nova-compute[75648]:         </nova:port>
Nov 15 05:50:08 user nova-compute[75648]:       </nova:ports>
Nov 15 05:50:08 user nova-compute[75648]:     </nova:instance>
Nov 15 05:50:08 user nova-compute[75648]:   </metadata>
Nov 15 05:50:08 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:50:08 user nova-compute[75648]:     <system>
Nov 15 05:50:08 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:50:08 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:50:08 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:50:08 user nova-compute[75648]:       <entry name="serial">59e7c593-d1f7-4ebf-8fa8-b0ae91c96903</entry>
Nov 15 05:50:08 user nova-compute[75648]:       <entry name="uuid">59e7c593-d1f7-4ebf-8fa8-b0ae91c96903</entry>
Nov 15 05:50:08 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:50:08 user nova-compute[75648]:     </system>
Nov 15 05:50:08 user nova-compute[75648]:   </sysinfo>
Nov 15 05:50:08 user nova-compute[75648]:   <os>
Nov 15 05:50:08 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:50:08 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:50:08 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:50:08 user nova-compute[75648]:   </os>
Nov 15 05:50:08 user nova-compute[75648]:   <features>
Nov 15 05:50:08 user nova-compute[75648]:     <acpi/>
Nov 15 05:50:08 user nova-compute[75648]:     <apic/>
Nov 15 05:50:08 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:50:08 user nova-compute[75648]:   </features>
Nov 15 05:50:08 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:50:08 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:50:08 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:50:08 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:50:08 user nova-compute[75648]:   </clock>
Nov 15 05:50:08 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:50:08 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:50:08 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:50:08 user nova-compute[75648]:   </cpu>
Nov 15 05:50:08 user nova-compute[75648]:   <devices>
Nov 15 05:50:08 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:50:08 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:50:08 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk"/>
Nov 15 05:50:08 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:50:08 user nova-compute[75648]:     </disk>
Nov 15 05:50:08 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:50:08 user nova-compute[75648]:       <mac address="fa:16:3e:dc:e3:c7"/>
Nov 15 05:50:08 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:50:08 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:50:08 user nova-compute[75648]:       <target dev="tap7d14ba8c-00"/>
Nov 15 05:50:08 user nova-compute[75648]:     </interface>
Nov 15 05:50:08 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:50:08 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/console.log" append="off"/>
Nov 15 05:50:08 user nova-compute[75648]:     </serial>
Nov 15 05:50:08 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:50:08 user nova-compute[75648]:     <video>
Nov 15 05:50:08 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:50:08 user nova-compute[75648]:     </video>
Nov 15 05:50:08 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:50:08 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:50:08 user nova-compute[75648]:     </rng>
Nov 15 05:50:08 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:50:08 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:50:08 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:50:08 user nova-compute[75648]:     </memballoon>
Nov 15 05:50:08 user nova-compute[75648]:   </devices>
Nov 15 05:50:08 user nova-compute[75648]: </domain>
Nov 15 05:50:08 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-927055105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-927055105',id=26,image_ref='b69c56d6-d55a-4e54-ad28-44f10c6f7d1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1905129680',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-i4r0o8lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member',shelved_at='2023-11-15T05:48:12.603174',shelved_host='user',shelved_image_id='b69c56d6-d55a-4e54-ad28-44f10c6f7d1b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=59e7c593-d1f7-4ebf-8fa8-b0ae91c96903,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG os_vif [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2078e822-526b-5fbb-94c3-a7bc5ef56bf9', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d14ba8c-00, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d14ba8c-00, col_values=(('qos', UUID('9b244178-2ba4-4dec-afee-f4738061184f')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d14ba8c-00, col_values=(('external_ids', {'iface-id': '7d14ba8c-00f2-4218-affc-cf872dda8026', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dc:e3:c7', 'vm-uuid': '59e7c593-d1f7-4ebf-8fa8-b0ae91c96903'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:08 user nova-compute[75648]: INFO os_vif [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00')
Nov 15 05:50:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:50:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] No VIF found with MAC fa:16:3e:dc:e3:c7, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-7e3db914-3372-4605-9fe4-cfb7a567023f req-ff4d24a5-f8e0-4371-8fcb-19385ab72b7b service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7e3db914-3372-4605-9fe4-cfb7a567023f req-ff4d24a5-f8e0-4371-8fcb-19385ab72b7b service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7e3db914-3372-4605-9fe4-cfb7a567023f req-ff4d24a5-f8e0-4371-8fcb-19385ab72b7b service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7e3db914-3372-4605-9fe4-cfb7a567023f req-ff4d24a5-f8e0-4371-8fcb-19385ab72b7b service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-7e3db914-3372-4605-9fe4-cfb7a567023f req-ff4d24a5-f8e0-4371-8fcb-19385ab72b7b service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:10 user nova-compute[75648]: WARNING nova.compute.manager [req-7e3db914-3372-4605-9fe4-cfb7a567023f req-ff4d24a5-f8e0-4371-8fcb-19385ab72b7b service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 05:50:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:11 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e is timed out.
Nov 15 05:50:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully detached device vdb from instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e from the live domain config.
Nov 15 05:50:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdcIaPXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:50:11 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4316fb-1614-4638-8558-9a13119aecb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:50:11 user nova-compute[75648]: No targets found.
Nov 15 05:50:11 user nova-compute[75648]: iSNS:
Nov 15 05:50:11 user nova-compute[75648]: No targets found.
Nov 15 05:50:11 user nova-compute[75648]: STATIC:
Nov 15 05:50:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:50:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:50:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7
Nov 15 05:50:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:50:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:11 user nova-compute[75648]: FIRMWARE:
Nov 15 05:50:11 user nova-compute[75648]: No targets found.
Nov 15 05:50:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:50:11 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:50:11 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbf3515-6df6-4446-ac3a-a5ad6ea8611d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d763f4c5-b0af-4c30-ab6d-bf7344f8fc28]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:11 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:11 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:11 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:50:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:11 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:11 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:11 user nova-compute[75648]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 (non-flash)
Nov 15 05:50:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8611ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3a0cad-56ae-45ff-9ea9-ff21a318ed0e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9701e7f4-9fd1-475f-b4c5-f7fbba2ecfe6]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3a361e-ba09-44d9-9ede-723397b98ce8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.062s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a55103-5340-4aa0-a65f-e7a7c7a3fcb1]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c45338-167c-40f5-abd5-816348ed5725]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff6c39a-1ae4-42ca-9254-7fb9c03e9352]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260]
Nov 15 05:50:11 user nova-compute[75648]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7, portal: 172.16.0.220,3260] successful.
Nov 15 05:50:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddf0ead-5abe-4555-a3fe-6bc578e312bf]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== disconnect_volume: return (342ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:50:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:50:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:50:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:50:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance spawned successfully.
Nov 15 05:50:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-fd38a43a-a319-41af-9ac0-e34e502a15dd req-b32abca0-efc8-4ad4-9ea4-2672cfd3b647 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fd38a43a-a319-41af-9ac0-e34e502a15dd req-b32abca0-efc8-4ad4-9ea4-2672cfd3b647 service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fd38a43a-a319-41af-9ac0-e34e502a15dd req-b32abca0-efc8-4ad4-9ea4-2672cfd3b647 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fd38a43a-a319-41af-9ac0-e34e502a15dd req-b32abca0-efc8-4ad4-9ea4-2672cfd3b647 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-fd38a43a-a319-41af-9ac0-e34e502a15dd req-b32abca0-efc8-4ad4-9ea4-2672cfd3b647 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:12 user nova-compute[75648]: WARNING nova.compute.manager [req-fd38a43a-a319-41af-9ac0-e34e502a15dd req-b32abca0-efc8-4ad4-9ea4-2672cfd3b647 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 05:50:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25def5d7-3305-469c-b5b9-db98c6a1acc4 tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.765s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'flavor' on Instance uuid c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ec335ce3-00e3-4bc3-bdd3-92e3502dc73b tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.418s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 22.297s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:13 user nova-compute[75648]: INFO nova.compute.manager [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Terminating instance
Nov 15 05:50:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Starting finish_migration {{(pid=75648) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:50:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Creating image(s)
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk. size=21474836480 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk 21474836480 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Instance destroyed successfully.
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.objects.instance [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'resources' on Instance uuid c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-987070567',display_name='tempest-VolumesSnapshotTestJSON-instance-987070567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-987070567',id=31,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIGNcvquQfhECzB4O8awvlxEAt3erdm1nCFZX9nVmiUvhSJfKC/CiuAPbZVGObLkc4dCxQWJnI/B5tjqQCYJHaNrHvNtldnQN8UqW+HtDxONmDjLaC2D8bsgRLLDhdXbA==',key_name='tempest-keypair-821080195',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:47:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f018e72ae1144091adb4ae568a3926a0',ramdisk_id='',reservation_id='r-m26ky5lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1092113651',owner_user_name='tempest-VolumesSnapshotTestJSON-1092113651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:47:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b746581c3514859949345b4a3c3b03c',uuid=c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converting VIF {"id": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "address": "fa:16:3e:67:6d:e7", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14524ce-ee", "ovs_interfaceid": "b14524ce-ee45-46c9-bedb-5bebb63aa2d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_vif [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14524ce-ee, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c86f494c-b148-467c-8935-dec3a264f1f1) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:14 user nova-compute[75648]: INFO os_vif [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:6d:e7,bridge_name='br-int',has_traffic_filtering=True,id=b14524ce-ee45-46c9-bedb-5bebb63aa2d1,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14524ce-ee')
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk 21474836480" returned: 0 in 0.209s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdcIaPXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:50:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Ensure instance console log exists: /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start _get_guest_xml network_info=[{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'da3dc87d-ec10-479c-8216-e720e86414a8', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cad9c255-6774-4949-940a-df74f84d3feb', 'attached_at': '2023-11-15T05:50:13.000000', 'detached_at': '', 'volume_id': '50879f6c-d4f9-45d9-b06a-e176925f814d', 'serial': '50879f6c-d4f9-45d9-b06a-e176925f814d'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1150e5c5-187f-4c84-8e07-03b557003420]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:50:14 user nova-compute[75648]: No targets found.
Nov 15 05:50:14 user nova-compute[75648]: iSNS:
Nov 15 05:50:14 user nova-compute[75648]: No targets found.
Nov 15 05:50:14 user nova-compute[75648]: STATIC:
Nov 15 05:50:14 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:50:14 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:14 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:14 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:50:14 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:14 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:14 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:50:14 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:14 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:14 user nova-compute[75648]: FIRMWARE:
Nov 15 05:50:14 user nova-compute[75648]: No targets found.
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:50:14 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:50:14 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4598b1aa-637e-46b9-b67b-e529001aecf7', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:50:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3411e3-9f5d-4684-9c1e-25caa50d2418]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34abeba-2cb1-4935-ac11-558df062b2fc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e86b44c0>, {}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Disconnecting from: [] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.105s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== disconnect_volume: return (107ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:50:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Deleting instance files /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e_del
Nov 15 05:50:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Deletion of /opt/stack/data/nova/instances/c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e_del complete
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.037s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:50:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:50:14 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[132caab8-76e8-4d47-a71c-505dace196a9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:50:14 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d53caa63-0eb4-4249-a66b-af31361c589b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d] added
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: INFO nova.compute.manager [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Took 1.07 seconds to destroy the instance on the hypervisor.
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4694d3c2-3bb2-4a02-b32e-136733b4b489]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a60300-e8f1-4d33-85d7-be1940fb6bd9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUVYEDj {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUVYEDj" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f92e4-a1db-46e1-a471-3c9af3a44aa6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTUVYEDj'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc218466-70d8-4c2c-ba0f-7063f30a97eb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ff7ead-bcc1-4c9e-86f0-cbbafa85f7b6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b982ea-31c1-4ad2-9cd4-e275e314f4f0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]
Nov 15 05:50:14 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4684e3-8b38-4a54-9878-1db42d8a7a02]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbd9f45-4d59-4ffb-87fd-39d0326fb380]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:14 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:50:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd6d7a-4550-4add-bec0-895f60a05c3d]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-vif-unplugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] No waiting events found dispatching network-vif-unplugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-vif-unplugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] Acquiring lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] No waiting events found dispatching network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:14 user nova-compute[75648]: WARNING nova.compute.manager [req-49ca964a-e0b0-4980-b7d2-5d194c4bcd0f req-9a7eb380-c0b7-4924-b280-6e27939ef379 service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received unexpected event network-vif-plugged-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 for instance with vm_state active and task_state deleting.
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:15 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Took 0.94 seconds to deallocate network for instance.
Nov 15 05:50:15 user nova-compute[75648]: WARNING nova.volume.cinder [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Attachment 5e0d0ebd-48aa-4357-9407-c8a8290e24b0 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5e0d0ebd-48aa-4357-9407-c8a8290e24b0. (HTTP 404) (Request-ID: req-277668d8-c9b1-4e6b-9408-7afafd64200b)
Nov 15 05:50:15 user nova-compute[75648]: INFO nova.compute.manager [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 05:50:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23330616236353531', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330616236353531', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:50:15 user nova-compute[75648]:   <uuid>cad9c255-6774-4949-940a-df74f84d3feb</uuid>
Nov 15 05:50:15 user nova-compute[75648]:   <name>instance-00000019</name>
Nov 15 05:50:15 user nova-compute[75648]:   <memory>2097152</memory>
Nov 15 05:50:15 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:50:15 user nova-compute[75648]:   <metadata>
Nov 15 05:50:15 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:50:15 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:50:15 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherB-server-2035674182</nova:name>
Nov 15 05:50:15 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:50:14</nova:creationTime>
Nov 15 05:50:15 user nova-compute[75648]:       <nova:flavor name="m1.small">
Nov 15 05:50:15 user nova-compute[75648]:         <nova:memory>2048</nova:memory>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:disk>20</nova:disk>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:50:15 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:50:15 user nova-compute[75648]:       <nova:owner>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:user uuid="306a53f7ef404302b5d26be66e11562f">tempest-ServerActionsTestOtherB-1116144874-project-member</nova:user>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:project uuid="915d7e6dbaaa42bf9100917ef6ce0824">tempest-ServerActionsTestOtherB-1116144874</nova:project>
Nov 15 05:50:15 user nova-compute[75648]:       </nova:owner>
Nov 15 05:50:15 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:50:15 user nova-compute[75648]:       <nova:ports>
Nov 15 05:50:15 user nova-compute[75648]:         <nova:port uuid="c5e72138-d273-4bb1-ac14-8e5f88e04114">
Nov 15 05:50:15 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:50:15 user nova-compute[75648]:         </nova:port>
Nov 15 05:50:15 user nova-compute[75648]:       </nova:ports>
Nov 15 05:50:15 user nova-compute[75648]:     </nova:instance>
Nov 15 05:50:15 user nova-compute[75648]:   </metadata>
Nov 15 05:50:15 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:50:15 user nova-compute[75648]:     <system>
Nov 15 05:50:15 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:50:15 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:50:15 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:50:15 user nova-compute[75648]:       <entry name="serial">cad9c255-6774-4949-940a-df74f84d3feb</entry>
Nov 15 05:50:15 user nova-compute[75648]:       <entry name="uuid">cad9c255-6774-4949-940a-df74f84d3feb</entry>
Nov 15 05:50:15 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:50:15 user nova-compute[75648]:     </system>
Nov 15 05:50:15 user nova-compute[75648]:   </sysinfo>
Nov 15 05:50:15 user nova-compute[75648]:   <os>
Nov 15 05:50:15 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:50:15 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:50:15 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:50:15 user nova-compute[75648]:   </os>
Nov 15 05:50:15 user nova-compute[75648]:   <features>
Nov 15 05:50:15 user nova-compute[75648]:     <acpi/>
Nov 15 05:50:15 user nova-compute[75648]:     <apic/>
Nov 15 05:50:15 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:50:15 user nova-compute[75648]:   </features>
Nov 15 05:50:15 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:50:15 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:50:15 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:50:15 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:50:15 user nova-compute[75648]:   </clock>
Nov 15 05:50:15 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:50:15 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:50:15 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:50:15 user nova-compute[75648]:   </cpu>
Nov 15 05:50:15 user nova-compute[75648]:   <devices>
Nov 15 05:50:15 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:50:15 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:50:15 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk"/>
Nov 15 05:50:15 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:50:15 user nova-compute[75648]:     </disk>
Nov 15 05:50:15 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:50:15 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:50:15 user nova-compute[75648]:       <source dev="/dev/sdd"/>
Nov 15 05:50:15 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:50:15 user nova-compute[75648]:       <serial>50879f6c-d4f9-45d9-b06a-e176925f814d</serial>
Nov 15 05:50:15 user nova-compute[75648]:     </disk>
Nov 15 05:50:15 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:50:15 user nova-compute[75648]:       <mac address="fa:16:3e:9a:5e:31"/>
Nov 15 05:50:15 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:50:15 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:50:15 user nova-compute[75648]:       <target dev="tapc5e72138-d2"/>
Nov 15 05:50:15 user nova-compute[75648]:     </interface>
Nov 15 05:50:15 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:50:15 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/console.log" append="off"/>
Nov 15 05:50:15 user nova-compute[75648]:     </serial>
Nov 15 05:50:15 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:50:15 user nova-compute[75648]:     <video>
Nov 15 05:50:15 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:50:15 user nova-compute[75648]:     </video>
Nov 15 05:50:15 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:50:15 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:50:15 user nova-compute[75648]:     </rng>
Nov 15 05:50:15 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:50:15 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:50:15 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:50:15 user nova-compute[75648]:     </memballoon>
Nov 15 05:50:15 user nova-compute[75648]:   </devices>
Nov 15 05:50:15 user nova-compute[75648]: </domain>
Nov 15 05:50:15 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:46:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-254289440-network", "vif_mac": "fa:16:3e:9a:5e:31"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG os_vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b723c82c-ed01-5f95-b64b-066cc4061458', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e72138-d2, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5e72138-d2, col_values=(('qos', UUID('69e99808-c0b1-4ab8-949a-eb508eec444b')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5e72138-d2, col_values=(('external_ids', {'iface-id': 'c5e72138-d273-4bb1-ac14-8e5f88e04114', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:5e:31', 'vm-uuid': 'cad9c255-6774-4949-940a-df74f84d3feb'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:15 user nova-compute[75648]: INFO os_vif [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2')
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:50:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] No VIF found with MAC fa:16:3e:9a:5e:31, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:50:16 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:50:16 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:50:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:16 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Deleted allocations for instance c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e
Nov 15 05:50:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7280ec13-e0db-40fc-b966-e9fe391b72bf tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.892s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-41335342-a233-40d5-be45-9dceb7934493 req-77a531e4-5fda-46f2-8842-27d753de393d service nova] [instance: c2c1cf36-5325-4a4c-b6a2-dcbaec50c10e] Received event network-vif-deleted-b14524ce-ee45-46c9-bedb-5bebb63aa2d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:19 user nova-compute[75648]: WARNING nova.compute.manager [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state active and task_state resize_finish.
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:19 user nova-compute[75648]: WARNING nova.compute.manager [req-90b65d27-4b7c-4a0e-b9c3-61cb7bc71924 req-3ea54637-e478-48b9-8f24-01ae62d72c32 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state active and task_state resize_finish.
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:50:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance running successfully.
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Failed to set time: agent not configured {{(pid=75648) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 05:50:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a034459e-f9c2-4744-9fa0-95cb4792581c tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] finish_migration finished successfully. {{(pid=75648) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 05:50:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-changed-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Refreshing instance network info cache due to event network-changed-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:50:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:31 user nova-compute[75648]: DEBUG nova.network.neutron [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Refreshing network info cache for port 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:50:32 user nova-compute[75648]: DEBUG nova.network.neutron [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated VIF entry in instance network info cache for port 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:50:32 user nova-compute[75648]: DEBUG nova.network.neutron [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9115b423-81b4-4f75-a274-f6485a4f4ee3 req-1e773320-e212-4757-98e6-e4de66afcdec service nova] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:50:52 user nova-compute[75648]: INFO nova.compute.claims [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Claim successful on node user
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-changed-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Refreshing instance network info cache due to event network-changed-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] Acquiring lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] Acquired lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Refreshing network info cache for port c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.network.neutron [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:50:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:50:52 user nova-compute[75648]: DEBUG nova.policy [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2b746581c3514859949345b4a3c3b03c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f018e72ae1144091adb4ae568a3926a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:50:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Creating image(s)
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "/opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "/opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.network.neutron [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updated VIF entry in instance network info cache for port c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.network.neutron [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updating instance_info_cache with network_info: [{"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-547f80b7-2854-46ac-a801-3c28907eade6 req-4ffd2234-4358-413e-a9ea-88eb7f3d6607 service nova] Releasing lock "refresh_cache-da4b88ea-7af5-4a88-819a-e0c62cbe338e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:53 user nova-compute[75648]: INFO nova.compute.manager [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Terminating instance
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.201s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk 1073741824" returned: 0 in 0.052s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0a9d3ec-f18e-4296-a525-8c0843be9e2a req-45735065-4343-4be0-bdef-9da95e6cfc75 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-vif-unplugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0a9d3ec-f18e-4296-a525-8c0843be9e2a req-45735065-4343-4be0-bdef-9da95e6cfc75 service nova] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0a9d3ec-f18e-4296-a525-8c0843be9e2a req-45735065-4343-4be0-bdef-9da95e6cfc75 service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0a9d3ec-f18e-4296-a525-8c0843be9e2a req-45735065-4343-4be0-bdef-9da95e6cfc75 service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0a9d3ec-f18e-4296-a525-8c0843be9e2a req-45735065-4343-4be0-bdef-9da95e6cfc75 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] No waiting events found dispatching network-vif-unplugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0a9d3ec-f18e-4296-a525-8c0843be9e2a req-45735065-4343-4be0-bdef-9da95e6cfc75 service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-vif-unplugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Cannot resize image /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Ensure instance console log exists: /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Instance destroyed successfully.
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'resources' on Instance uuid da4b88ea-7af5-4a88-819a-e0c62cbe338e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:48:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1813895615',display_name='tempest-TestVolumeBootPattern-server-1813895615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1813895615',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-iq3swtep',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:49:11Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=da4b88ea-7af5-4a88-819a-e0c62cbe338e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "address": "fa:16:3e:1f:09:8e", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3bbdf3a-a2", "ovs_interfaceid": "c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_vif [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3bbdf3a-a2, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.network.neutron [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Successfully created port: f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1dc8ce3-1359-4ced-a7ea-2a24c51a4716) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:53 user nova-compute[75648]: INFO os_vif [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:09:8e,bridge_name='br-int',has_traffic_filtering=True,id=c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3bbdf3a-a2')
Nov 15 05:50:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:50:53 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b81bd77-0da1-45f6-ae70-70e45f482a5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:50:53 user nova-compute[75648]: No targets found.
Nov 15 05:50:53 user nova-compute[75648]: iSNS:
Nov 15 05:50:53 user nova-compute[75648]: No targets found.
Nov 15 05:50:53 user nova-compute[75648]: STATIC:
Nov 15 05:50:53 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:50:53 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:53 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:53 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:50:53 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:53 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:53 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:50:53 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:53 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:53 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:50:53 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:50:53 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:50:53 user nova-compute[75648]: FIRMWARE:
Nov 15 05:50:53 user nova-compute[75648]: No targets found.
Nov 15 05:50:53 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:50:53 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:50:53 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:50:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[343d94f7-a78b-4569-9e33-26aa32ef201d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92a140e-405c-48e9-987e-36b2b34fa68f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:54 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:54 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:54 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:50:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:50:54 user nova-compute[75648]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:50:54 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:50:54 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:50:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e84f1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[455f2c29-1480-4ac3-8479-45c2592ddbc5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26b8c22-56ff-44d6-98d7-a6dd01325a46]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27b2d71-ce3f-4607-8fe5-73537522bb9a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6c67f0-5ad2-4517-99e9-0a330628b9c9]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b31546-8de6-4e12-9c0a-46a8dbc45d8b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb08b8c-9ea3-4cd7-b481-97749ffcdfb9]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]
Nov 15 05:50:54 user nova-compute[75648]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.
Nov 15 05:50:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[296c7fde-26e3-4721-8f46-ff8fac72896f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== disconnect_volume: return (347ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:50:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Deleting instance files /opt/stack/data/nova/instances/da4b88ea-7af5-4a88-819a-e0c62cbe338e_del
Nov 15 05:50:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Deletion of /opt/stack/data/nova/instances/da4b88ea-7af5-4a88-819a-e0c62cbe338e_del complete
Nov 15 05:50:54 user nova-compute[75648]: INFO nova.compute.manager [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Successfully updated port: f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquired lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updating instance_info_cache with network_info: [{"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Releasing lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Instance network_info: |[{"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Start _get_guest_xml network_info=[{"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:50:54 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:54 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-526733281',display_name='tempest-VolumesSnapshotTestJSON-instance-526733281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-526733281',id=35,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkmvn+FRVYhRw8MnvKRt+iCOspCOe0q2h6cl7pHLjTc51ZPrAAQopLzKDOYCNLM8DcPQogEjrWCABge8WHwQN/STtuwbui/tJyhvhDuC2O0gsLsCQb5SwnnmxGrgCDcCw==',key_name='tempest-keypair-355185450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f018e72ae1144091adb4ae568a3926a0',ramdisk_id='',reservation_id='r-nqt0zuj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1092113651',owner_user_name='tempest-VolumesSnapshotTestJSON-1092113651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b746581c3514859949345b4a3c3b03c',uuid=5b473790-b699-419b-81be-b36b42f6ba5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converting VIF {"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b473790-b699-419b-81be-b36b42f6ba5a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:50:54 user nova-compute[75648]:   <uuid>5b473790-b699-419b-81be-b36b42f6ba5a</uuid>
Nov 15 05:50:54 user nova-compute[75648]:   <name>instance-00000023</name>
Nov 15 05:50:54 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:50:54 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:50:54 user nova-compute[75648]:   <metadata>
Nov 15 05:50:54 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:50:54 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:50:54 user nova-compute[75648]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-526733281</nova:name>
Nov 15 05:50:54 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:50:54</nova:creationTime>
Nov 15 05:50:54 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:50:54 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:50:54 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:50:54 user nova-compute[75648]:       <nova:owner>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:user uuid="2b746581c3514859949345b4a3c3b03c">tempest-VolumesSnapshotTestJSON-1092113651-project-member</nova:user>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:project uuid="f018e72ae1144091adb4ae568a3926a0">tempest-VolumesSnapshotTestJSON-1092113651</nova:project>
Nov 15 05:50:54 user nova-compute[75648]:       </nova:owner>
Nov 15 05:50:54 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:50:54 user nova-compute[75648]:       <nova:ports>
Nov 15 05:50:54 user nova-compute[75648]:         <nova:port uuid="f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607">
Nov 15 05:50:54 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 05:50:54 user nova-compute[75648]:         </nova:port>
Nov 15 05:50:54 user nova-compute[75648]:       </nova:ports>
Nov 15 05:50:54 user nova-compute[75648]:     </nova:instance>
Nov 15 05:50:54 user nova-compute[75648]:   </metadata>
Nov 15 05:50:54 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:50:54 user nova-compute[75648]:     <system>
Nov 15 05:50:54 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:50:54 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:50:54 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:50:54 user nova-compute[75648]:       <entry name="serial">5b473790-b699-419b-81be-b36b42f6ba5a</entry>
Nov 15 05:50:54 user nova-compute[75648]:       <entry name="uuid">5b473790-b699-419b-81be-b36b42f6ba5a</entry>
Nov 15 05:50:54 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:50:54 user nova-compute[75648]:     </system>
Nov 15 05:50:54 user nova-compute[75648]:   </sysinfo>
Nov 15 05:50:54 user nova-compute[75648]:   <os>
Nov 15 05:50:54 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:50:54 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:50:54 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:50:54 user nova-compute[75648]:   </os>
Nov 15 05:50:54 user nova-compute[75648]:   <features>
Nov 15 05:50:54 user nova-compute[75648]:     <acpi/>
Nov 15 05:50:54 user nova-compute[75648]:     <apic/>
Nov 15 05:50:54 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:50:54 user nova-compute[75648]:   </features>
Nov 15 05:50:54 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:50:54 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:50:54 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:50:54 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:50:54 user nova-compute[75648]:   </clock>
Nov 15 05:50:54 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:50:54 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:50:54 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:50:54 user nova-compute[75648]:   </cpu>
Nov 15 05:50:54 user nova-compute[75648]:   <devices>
Nov 15 05:50:54 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:50:54 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:50:54 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk"/>
Nov 15 05:50:54 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:50:54 user nova-compute[75648]:     </disk>
Nov 15 05:50:54 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:50:54 user nova-compute[75648]:       <mac address="fa:16:3e:ca:a2:22"/>
Nov 15 05:50:54 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:50:54 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:50:54 user nova-compute[75648]:       <target dev="tapf7e15dd8-b3"/>
Nov 15 05:50:54 user nova-compute[75648]:     </interface>
Nov 15 05:50:54 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:50:54 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/console.log" append="off"/>
Nov 15 05:50:54 user nova-compute[75648]:     </serial>
Nov 15 05:50:54 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:50:54 user nova-compute[75648]:     <video>
Nov 15 05:50:54 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:50:54 user nova-compute[75648]:     </video>
Nov 15 05:50:54 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:50:54 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:50:54 user nova-compute[75648]:     </rng>
Nov 15 05:50:54 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:50:54 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:50:54 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:50:54 user nova-compute[75648]:     </memballoon>
Nov 15 05:50:54 user nova-compute[75648]:   </devices>
Nov 15 05:50:54 user nova-compute[75648]: </domain>
Nov 15 05:50:54 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-526733281',display_name='tempest-VolumesSnapshotTestJSON-instance-526733281',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-526733281',id=35,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkmvn+FRVYhRw8MnvKRt+iCOspCOe0q2h6cl7pHLjTc51ZPrAAQopLzKDOYCNLM8DcPQogEjrWCABge8WHwQN/STtuwbui/tJyhvhDuC2O0gsLsCQb5SwnnmxGrgCDcCw==',key_name='tempest-keypair-355185450',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f018e72ae1144091adb4ae568a3926a0',ramdisk_id='',reservation_id='r-nqt0zuj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1092113651',owner_user_name='tempest-VolumesSnapshotTestJSON-1092113651-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b746581c3514859949345b4a3c3b03c',uuid=5b473790-b699-419b-81be-b36b42f6ba5a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converting VIF {"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG os_vif [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'da9ce2c1-79b1-5cff-b631-9dfd106cef20', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf7e15dd8-b3, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf7e15dd8-b3, col_values=(('qos', UUID('e76a3f44-eb4e-4302-9ece-ad0eedc97422')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf7e15dd8-b3, col_values=(('external_ids', {'iface-id': 'f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ca:a2:22', 'vm-uuid': '5b473790-b699-419b-81be-b36b42f6ba5a'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:54 user nova-compute[75648]: INFO os_vif [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3')
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:50:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No VIF found with MAC fa:16:3e:ca:a2:22, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:55 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Took 0.69 seconds to deallocate network for instance.
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-4e79a3ca-3f0f-4059-a1c3-035ee7b87997 req-a00a059f-5d04-4ef6-bb1f-7b26504facab service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-vif-deleted-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Skipping network cache update for instance because it is being deleted. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Skipping network cache update for instance because it is Building. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received event network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] Acquiring lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] No waiting events found dispatching network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:55 user nova-compute[75648]: WARNING nova.compute.manager [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Received unexpected event network-vif-plugged-c3bbdf3a-a24e-4b25-9bd4-7ef116efac0d for instance with vm_state active and task_state deleting.
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-changed-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Refreshing instance network info cache due to event network-changed-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] Acquiring lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] Acquired lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Refreshing network info cache for port f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updated VIF entry in instance network info cache for port f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updating instance_info_cache with network_info: [{"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dbe30e7b-b879-451d-8a2b-1077c8306ea5 req-22fe3935-fef9-4db9-a404-5bf4b843f2fe service nova] Releasing lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:56 user nova-compute[75648]: INFO nova.compute.manager [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: da4b88ea-7af5-4a88-819a-e0c62cbe338e] Took 1.08 seconds to detach 1 volumes for instance.
Nov 15 05:50:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [{"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-c6859cea-129c-472b-aba0-b609ddc5f89a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-8bf281bd-1490-4430-bf95-14a146d1e557 req-0646e819-664e-4516-a05a-7e2dc787a55d service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8bf281bd-1490-4430-bf95-14a146d1e557 req-0646e819-664e-4516-a05a-7e2dc787a55d service nova] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8bf281bd-1490-4430-bf95-14a146d1e557 req-0646e819-664e-4516-a05a-7e2dc787a55d service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8bf281bd-1490-4430-bf95-14a146d1e557 req-0646e819-664e-4516-a05a-7e2dc787a55d service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-8bf281bd-1490-4430-bf95-14a146d1e557 req-0646e819-664e-4516-a05a-7e2dc787a55d service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] No waiting events found dispatching network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:57 user nova-compute[75648]: WARNING nova.compute.manager [req-8bf281bd-1490-4430-bf95-14a146d1e557 req-0646e819-664e-4516-a05a-7e2dc787a55d service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received unexpected event network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 for instance with vm_state building and task_state spawning.
Nov 15 05:50:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.912s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:57 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Deleted allocations for instance da4b88ea-7af5-4a88-819a-e0c62cbe338e
Nov 15 05:50:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9df526f-f1d5-42cf-87d1-6ace86e9e65c tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "da4b88ea-7af5-4a88-819a-e0c62cbe338e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.121s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:50:58 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Instance spawned successfully.
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:50:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:50:59 user nova-compute[75648]: INFO nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 15 05:50:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:59 user nova-compute[75648]: INFO nova.compute.manager [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Took 6.88 seconds to build instance.
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-654be62f-754b-4e8c-94d0-8bf03a8407c5 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.978s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-0a18395f-48a7-443e-8e27-ba31ddb39d11 req-80eef834-9c46-4f9d-a443-830ab18148cc service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0a18395f-48a7-443e-8e27-ba31ddb39d11 req-80eef834-9c46-4f9d-a443-830ab18148cc service nova] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0a18395f-48a7-443e-8e27-ba31ddb39d11 req-80eef834-9c46-4f9d-a443-830ab18148cc service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0a18395f-48a7-443e-8e27-ba31ddb39d11 req-80eef834-9c46-4f9d-a443-830ab18148cc service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-0a18395f-48a7-443e-8e27-ba31ddb39d11 req-80eef834-9c46-4f9d-a443-830ab18148cc service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] No waiting events found dispatching network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:50:59 user nova-compute[75648]: WARNING nova.compute.manager [req-0a18395f-48a7-443e-8e27-ba31ddb39d11 req-80eef834-9c46-4f9d-a443-830ab18148cc service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received unexpected event network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 for instance with vm_state active and task_state None.
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:50:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:03 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:51:03 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7394MB free_disk=24.953632354736328GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Applying migration context for instance cad9c255-6774-4949-940a-df74f84d3feb as it has an incoming, in-progress migration 877eca90-5a78-43e0-9769-13c6076c1203. Migration status is finished {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 05:51:03 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating resource usage from migration 877eca90-5a78-43e0-9769-13c6076c1203
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 878ae6df-048e-4181-895e-64ad390935dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Migration 877eca90-5a78-43e0-9769-13c6076c1203 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5b473790-b699-419b-81be-b36b42f6ba5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:51:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:51:04 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:51:04 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:51:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:51:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.577s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:51:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:12 user nova-compute[75648]: INFO nova.compute.manager [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Unrescuing
Nov 15 05:51:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'flavor' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "64004f1c-2f3f-4d02-8632-823a13493b17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:51:13 user nova-compute[75648]: INFO nova.compute.claims [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Claim successful on node user
Nov 15 05:51:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-771620eb-d104-47ee-8f69-63b09a2c12ba req-cc1a06af-00b9-4bdd-b153-10f37b890f29 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-771620eb-d104-47ee-8f69-63b09a2c12ba req-cc1a06af-00b9-4bdd-b153-10f37b890f29 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-771620eb-d104-47ee-8f69-63b09a2c12ba req-cc1a06af-00b9-4bdd-b153-10f37b890f29 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-771620eb-d104-47ee-8f69-63b09a2c12ba req-cc1a06af-00b9-4bdd-b153-10f37b890f29 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-771620eb-d104-47ee-8f69-63b09a2c12ba req-cc1a06af-00b9-4bdd-b153-10f37b890f29 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:13 user nova-compute[75648]: WARNING nova.compute.manager [req-771620eb-d104-47ee-8f69-63b09a2c12ba req-cc1a06af-00b9-4bdd-b153-10f37b890f29 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:51:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:51:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance destroyed successfully.
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:51:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:51:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:51:14 user nova-compute[75648]: DEBUG nova.policy [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '47b4817a59584433a28790c3a16d0b5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c13f9a55b45f4f9992e2f86628b34982', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:51:14 user nova-compute[75648]: INFO nova.virt.block_device [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Booting with volume-backed-image 72e9a4f4-242e-472f-a069-4362bff1d397 at /dev/vda
Nov 15 05:51:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Successfully created port: a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'flavor' on Instance uuid 878ae6df-048e-4181-895e-64ad390935dc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Successfully updated port: a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-changed-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Refreshing instance network info cache due to event network-changed-a6ef8671-4b2e-4715-a58c-ebc9ea360446. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] Acquiring lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:15 user nova-compute[75648]: DEBUG nova.network.neutron [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-c98f0037-e78d-4b1c-a412-3b0e099c3d5e req-4262c7ad-9e19-49f8-b9a1-e579e9bf48f0 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c98f0037-e78d-4b1c-a412-3b0e099c3d5e req-4262c7ad-9e19-49f8-b9a1-e579e9bf48f0 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c98f0037-e78d-4b1c-a412-3b0e099c3d5e req-4262c7ad-9e19-49f8-b9a1-e579e9bf48f0 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c98f0037-e78d-4b1c-a412-3b0e099c3d5e req-4262c7ad-9e19-49f8-b9a1-e579e9bf48f0 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-c98f0037-e78d-4b1c-a412-3b0e099c3d5e req-4262c7ad-9e19-49f8-b9a1-e579e9bf48f0 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:16 user nova-compute[75648]: WARNING nova.compute.manager [req-c98f0037-e78d-4b1c-a412-3b0e099c3d5e req-4262c7ad-9e19-49f8-b9a1-e579e9bf48f0 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:16 user nova-compute[75648]: INFO nova.compute.manager [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Attaching volume b8b88110-91d8-45cd-bf88-7f0d968f4d64 to /dev/vdb
Nov 15 05:51:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG os_brick.utils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d653e5c-999d-45c5-b1ef-6347774967a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88a443d-095f-4c89-b575-d6c5a25fec34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aaea44-c12a-4b48-b95c-6b58905a17c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3404bfe-76a0-4d37-ab04-7ddfe3ead758]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updating instance_info_cache with network_info: [{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance network_info: |[{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:16 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffec17af-91e8-4431-8649-df3a811a545d]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] Acquired lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Refreshing network info cache for port a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG os_brick.utils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating existing volume attachment record: e246327a-623b-4fa3-8162-9baab6a683b7 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updated VIF entry in instance network info cache for port a6ef8671-4b2e-4715-a58c-ebc9ea360446. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG nova.network.neutron [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updating instance_info_cache with network_info: [{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9eed0708-3553-4632-8626-621e9f9b2e40 req-24f29835-873b-4c30-b197-721cf3980231 service nova] Releasing lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-45e9cb37-4893-4d74-b0ed-caceabbb55cd tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:18 user nova-compute[75648]: WARNING nova.compute.manager [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state active and task_state None.
Nov 15 05:51:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:18 user nova-compute[75648]: WARNING nova.compute.manager [req-043b5614-d185-4c0b-bbc7-9c549d007662 req-e2a2780a-4e25-4963-ad37-a7612b369b78 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state active and task_state None.
Nov 15 05:51:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG os_brick.utils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a928b74-74ce-4a6c-86d1-5f37a3b8c636]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[00295b24-3548-4e65-bf04-8fb2f305218a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b680bc-3eb0-4d5c-ab1d-681742989bf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb5355d-85b2-4ab0-a8c9-492992fd7543]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:20 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:51:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd38eb9-babb-4214-9784-aecc99a16525]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG os_brick.utils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:20 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updating existing volume attachment record: 30c288a2-cbdf-4c0c-9b6a-45c02919fd9b {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErTeAYXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:21 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:21 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:21 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[87dd1335-5bea-456c-a687-e63f6f698384]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:51:21 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4872204c-f13e-4a6c-b2e7-552c5ca0632b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64] added
Nov 15 05:51:21 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13ee31-15e0-41c2-9323-370ec425cb9d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3733170-de56-412a-ab54-23b6a52317b8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErTeAYXB {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ErTeAYXB" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[81251775-b0e3-4717-b77d-4fa2da8fbc0e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ErTeAYXB'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[412b6f8b-bb73-4d43-b833-17874530443b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d27b0c2-7121-4056-8af0-d61986d43df5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:21 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:21 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac3f10-aa96-49e4-87c1-12da2a7d60f1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260]
Nov 15 05:51:21 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260] successful.
Nov 15 05:51:21 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e694fe-7309-4ef0-bab5-922d57fd1411]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaaacf8-f9ac-4b0b-9f6a-aace366dfb9d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:21 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:21 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:21 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c872d449-1c1b-43f0-bfc4-f2b11e2d8ab3]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:51:21 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErTeAYXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23337363439343233', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23337363439343233', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'flavor' on Instance uuid 878ae6df-048e-4181-895e-64ad390935dc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:51:22 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:51:22 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:51:22 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:51:22 user nova-compute[75648]:   <serial>b8b88110-91d8-45cd-bf88-7f0d968f4d64</serial>
Nov 15 05:51:22 user nova-compute[75648]: </disk>
Nov 15 05:51:22 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:51:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] No VIF found with MAC fa:16:3e:39:f8:f0, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:51:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b40e89e0-a1f8-4f0a-b077-125dda1ac765 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.987s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:51:25 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Creating image(s)
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Ensure instance console log exists: /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Start _get_guest_xml network_info=[{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '30c288a2-cbdf-4c0c-9b6a-45c02919fd9b', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '64004f1c-2f3f-4d02-8632-823a13493b17', 'attached_at': '', 'detached_at': '', 'volume_id': '4fa6f397-6fd1-4288-8d83-f067873acd2f', 'serial': '4fa6f397-6fd1-4288-8d83-f067873acd2f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:51:25 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:51:25 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:25 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:25 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:25 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5ffe13-bea4-4978-8324-0659ecba2f0d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:51:25 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5eb0c2-eb2a-4891-ab09-d243b05e3148]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f] added
Nov 15 05:51:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[557f95a3-8974-4c24-924c-f80c9f1b2f79]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07ec49b-fa81-4e06-9661-1cecd91259a5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrFTqEYI {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrFTqEYI" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe29123-cb9e-4eb2-a187-f1de661fb7b0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrFTqEYI'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c81373d-3d57-40da-82fd-a5e9bf55419d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba8b5ba-b908-4c62-9216-8fca7651dc0c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing instance network info cache due to event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[875538dc-b3ec-4d5c-a339-a935ee814147]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260]
Nov 15 05:51:25 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260] successful.
Nov 15 05:51:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3001e929-24bb-491a-a7a7-a3143035c4a3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3b3666-86d3-4f21-8117-b632a2c12cfb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:25 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa82ba1-00d8-4abc-8324-4d86be1197ae]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:25 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.network.neutron [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updated VIF entry in instance network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.network.neutron [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-85a39e91-673d-443c-bae6-976f13294c2b req-2ae0085d-a4c4-4a66-9c32-0006d7a5bdbb service nova] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23466313736663634', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466313736663634', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1854119887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1854119887',id=36,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-4s3zb3l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:51:15Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=64004f1c-2f3f-4d02-8632-823a13493b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.objects.instance [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'pci_devices' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:51:26 user nova-compute[75648]:   <uuid>64004f1c-2f3f-4d02-8632-823a13493b17</uuid>
Nov 15 05:51:26 user nova-compute[75648]:   <name>instance-00000024</name>
Nov 15 05:51:26 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:51:26 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:51:26 user nova-compute[75648]:   <metadata>
Nov 15 05:51:26 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:51:26 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:51:26 user nova-compute[75648]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1854119887</nova:name>
Nov 15 05:51:26 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:51:25</nova:creationTime>
Nov 15 05:51:26 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:51:26 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:51:26 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:51:26 user nova-compute[75648]:       <nova:owner>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:user uuid="47b4817a59584433a28790c3a16d0b5c">tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member</nova:user>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:project uuid="c13f9a55b45f4f9992e2f86628b34982">tempest-ServerBootFromVolumeStableRescueTest-893883912</nova:project>
Nov 15 05:51:26 user nova-compute[75648]:       </nova:owner>
Nov 15 05:51:26 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:51:26 user nova-compute[75648]:       <nova:ports>
Nov 15 05:51:26 user nova-compute[75648]:         <nova:port uuid="a6ef8671-4b2e-4715-a58c-ebc9ea360446">
Nov 15 05:51:26 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 05:51:26 user nova-compute[75648]:         </nova:port>
Nov 15 05:51:26 user nova-compute[75648]:       </nova:ports>
Nov 15 05:51:26 user nova-compute[75648]:     </nova:instance>
Nov 15 05:51:26 user nova-compute[75648]:   </metadata>
Nov 15 05:51:26 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:51:26 user nova-compute[75648]:     <system>
Nov 15 05:51:26 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:51:26 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:51:26 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:51:26 user nova-compute[75648]:       <entry name="serial">64004f1c-2f3f-4d02-8632-823a13493b17</entry>
Nov 15 05:51:26 user nova-compute[75648]:       <entry name="uuid">64004f1c-2f3f-4d02-8632-823a13493b17</entry>
Nov 15 05:51:26 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:51:26 user nova-compute[75648]:     </system>
Nov 15 05:51:26 user nova-compute[75648]:   </sysinfo>
Nov 15 05:51:26 user nova-compute[75648]:   <os>
Nov 15 05:51:26 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:51:26 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:51:26 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:51:26 user nova-compute[75648]:   </os>
Nov 15 05:51:26 user nova-compute[75648]:   <features>
Nov 15 05:51:26 user nova-compute[75648]:     <acpi/>
Nov 15 05:51:26 user nova-compute[75648]:     <apic/>
Nov 15 05:51:26 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:51:26 user nova-compute[75648]:   </features>
Nov 15 05:51:26 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:51:26 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:51:26 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:51:26 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:51:26 user nova-compute[75648]:   </clock>
Nov 15 05:51:26 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:51:26 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:51:26 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:51:26 user nova-compute[75648]:   </cpu>
Nov 15 05:51:26 user nova-compute[75648]:   <devices>
Nov 15 05:51:26 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:51:26 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:51:26 user nova-compute[75648]:       <source dev="/dev/sdf"/>
Nov 15 05:51:26 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:51:26 user nova-compute[75648]:       <serial>4fa6f397-6fd1-4288-8d83-f067873acd2f</serial>
Nov 15 05:51:26 user nova-compute[75648]:     </disk>
Nov 15 05:51:26 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:51:26 user nova-compute[75648]:       <mac address="fa:16:3e:e9:99:2a"/>
Nov 15 05:51:26 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:51:26 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:51:26 user nova-compute[75648]:       <target dev="tapa6ef8671-4b"/>
Nov 15 05:51:26 user nova-compute[75648]:     </interface>
Nov 15 05:51:26 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:51:26 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/console.log" append="off"/>
Nov 15 05:51:26 user nova-compute[75648]:     </serial>
Nov 15 05:51:26 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:51:26 user nova-compute[75648]:     <video>
Nov 15 05:51:26 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:51:26 user nova-compute[75648]:     </video>
Nov 15 05:51:26 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:51:26 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:51:26 user nova-compute[75648]:     </rng>
Nov 15 05:51:26 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:51:26 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:51:26 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:51:26 user nova-compute[75648]:     </memballoon>
Nov 15 05:51:26 user nova-compute[75648]:   </devices>
Nov 15 05:51:26 user nova-compute[75648]: </domain>
Nov 15 05:51:26 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1854119887',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1854119887',id=36,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-4s3zb3l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:51:15Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=64004f1c-2f3f-4d02-8632-823a13493b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG os_vif [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c661d0de-8549-53ff-acd0-c48d22331e37', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6ef8671-4b, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6ef8671-4b, col_values=(('qos', UUID('8b2cc31d-edf4-4683-bcd3-6990d68b4995')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6ef8671-4b, col_values=(('external_ids', {'iface-id': 'a6ef8671-4b2e-4715-a58c-ebc9ea360446', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:99:2a', 'vm-uuid': '64004f1c-2f3f-4d02-8632-823a13493b17'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:26 user nova-compute[75648]: INFO os_vif [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b')
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:51:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No VIF found with MAC fa:16:3e:e9:99:2a, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing instance network info cache due to event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-65e45d63-6f19-417e-9b6e-75cbc04af1e7 req-0c5c5d33-5612-45ac-98f3-bcb7c93e039e service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-65e45d63-6f19-417e-9b6e-75cbc04af1e7 req-0c5c5d33-5612-45ac-98f3-bcb7c93e039e service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-65e45d63-6f19-417e-9b6e-75cbc04af1e7 req-0c5c5d33-5612-45ac-98f3-bcb7c93e039e service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-65e45d63-6f19-417e-9b6e-75cbc04af1e7 req-0c5c5d33-5612-45ac-98f3-bcb7c93e039e service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-65e45d63-6f19-417e-9b6e-75cbc04af1e7 req-0c5c5d33-5612-45ac-98f3-bcb7c93e039e service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:28 user nova-compute[75648]: WARNING nova.compute.manager [req-65e45d63-6f19-417e-9b6e-75cbc04af1e7 req-0c5c5d33-5612-45ac-98f3-bcb7c93e039e service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state building and task_state spawning.
Nov 15 05:51:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:29 user nova-compute[75648]: INFO nova.compute.manager [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Rebooting instance
Nov 15 05:51:29 user nova-compute[75648]: DEBUG nova.network.neutron [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updated VIF entry in instance network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG nova.network.neutron [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-79eb8eb6-3f68-4948-b71a-f649fc03111e req-4577c20e-7163-4ceb-9e5d-dc66f42ddb55 service nova] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG nova.network.neutron [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:51:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance spawned successfully.
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-cfda1699-3727-4e8b-9526-525ce2cb1515 req-8c4b7e96-b007-4d57-a8b6-99ccc3b1cc47 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cfda1699-3727-4e8b-9526-525ce2cb1515 req-8c4b7e96-b007-4d57-a8b6-99ccc3b1cc47 service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cfda1699-3727-4e8b-9526-525ce2cb1515 req-8c4b7e96-b007-4d57-a8b6-99ccc3b1cc47 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cfda1699-3727-4e8b-9526-525ce2cb1515 req-8c4b7e96-b007-4d57-a8b6-99ccc3b1cc47 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-cfda1699-3727-4e8b-9526-525ce2cb1515 req-8c4b7e96-b007-4d57-a8b6-99ccc3b1cc47 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:30 user nova-compute[75648]: WARNING nova.compute.manager [req-cfda1699-3727-4e8b-9526-525ce2cb1515 req-8c4b7e96-b007-4d57-a8b6-99ccc3b1cc47 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state building and task_state spawning.
Nov 15 05:51:31 user nova-compute[75648]: INFO nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Took 5.66 seconds to spawn the instance on the hypervisor.
Nov 15 05:51:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:51:31 user nova-compute[75648]: INFO nova.compute.manager [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Took 17.27 seconds to build instance.
Nov 15 05:51:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-092b6faa-b8d0-4a3e-9874-1f91805f9cbc tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "64004f1c-2f3f-4d02-8632-823a13493b17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.365s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-b849a920-8e28-4e45-9c6b-c18425acd7c1 req-25e4b3dd-2fca-42eb-9411-2d32a5d2f529 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-unplugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b849a920-8e28-4e45-9c6b-c18425acd7c1 req-25e4b3dd-2fca-42eb-9411-2d32a5d2f529 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b849a920-8e28-4e45-9c6b-c18425acd7c1 req-25e4b3dd-2fca-42eb-9411-2d32a5d2f529 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b849a920-8e28-4e45-9c6b-c18425acd7c1 req-25e4b3dd-2fca-42eb-9411-2d32a5d2f529 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-b849a920-8e28-4e45-9c6b-c18425acd7c1 req-25e4b3dd-2fca-42eb-9411-2d32a5d2f529 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-unplugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:32 user nova-compute[75648]: WARNING nova.compute.manager [req-b849a920-8e28-4e45-9c6b-c18425acd7c1 req-25e4b3dd-2fca-42eb-9411-2d32a5d2f529 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-unplugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state active and task_state reboot_started.
Nov 15 05:51:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance shutdown successfully.
Nov 15 05:51:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-dce7aa6b-1546-460b-88dd-29e361ab2cbf req-ad8461cb-6364-48ce-8cc2-9529fad42839 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dce7aa6b-1546-460b-88dd-29e361ab2cbf req-ad8461cb-6364-48ce-8cc2-9529fad42839 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dce7aa6b-1546-460b-88dd-29e361ab2cbf req-ad8461cb-6364-48ce-8cc2-9529fad42839 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dce7aa6b-1546-460b-88dd-29e361ab2cbf req-ad8461cb-6364-48ce-8cc2-9529fad42839 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-dce7aa6b-1546-460b-88dd-29e361ab2cbf req-ad8461cb-6364-48ce-8cc2-9529fad42839 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:34 user nova-compute[75648]: WARNING nova.compute.manager [req-dce7aa6b-1546-460b-88dd-29e361ab2cbf req-ad8461cb-6364-48ce-8cc2-9529fad42839 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state active and task_state reboot_started.
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:36 user nova-compute[75648]: WARNING nova.compute.manager [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state active and task_state reboot_started.
Nov 15 05:51:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:36 user nova-compute[75648]: WARNING nova.compute.manager [req-9a252d67-bc61-4c0b-8334-441b1b6f7b30 req-e43918d0-62a1-495a-be45-81da3c5becf0 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state active and task_state reboot_started.
Nov 15 05:51:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance running successfully.
Nov 15 05:51:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance soft rebooted successfully.
Nov 15 05:51:36 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0cdc5972-e471-429f-8f99-65b86cb4ffa4 tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.247s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:51:45 user nova-compute[75648]: INFO nova.compute.claims [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Claim successful on node user
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.471s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:51:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.policy [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd4a8513df14fc7ab09905d24220ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea832b577b9445782f27e28b1023e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:51:45 user nova-compute[75648]: INFO nova.virt.block_device [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Booting with volume 82037273-a7aa-4a6e-870e-4e53bbd209fa at /dev/vda
Nov 15 05:51:45 user nova-compute[75648]: DEBUG os_brick.utils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[666f2b32-2509-48bc-8cbc-5d9e9a9ec713]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[42882de6-b945-405c-8d30-3b9dd3fc1d03]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb5d1a6-bb89-4682-ad3a-5b6b6071074c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e37ebb-48b7-4624-bfd0-c800483772fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:45 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:51:45 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[240257e4-66fa-405e-bf93-e3697c77b9cc]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG os_brick.utils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:45 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updating existing volume attachment record: 18a650c5-2610-4324-8325-ffe83bde3743 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Successfully created port: 83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Successfully updated port: 83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquired lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-changed-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Refreshing instance network info cache due to event network-changed-83f94d30-6074-487a-a9b2-8bf156cfdc70. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] Acquiring lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updating instance_info_cache with network_info: [{"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Releasing lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Instance network_info: |[{"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] Acquired lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG nova.network.neutron [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Refreshing network info cache for port 83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG nova.network.neutron [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updated VIF entry in instance network info cache for port 83f94d30-6074-487a-a9b2-8bf156cfdc70. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG nova.network.neutron [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updating instance_info_cache with network_info: [{"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0dd685e-1b59-4e16-a0bb-1a2f77622608 req-03d6d6de-4acb-4d4e-8dc7-cb1d06c88185 service nova] Releasing lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:51:50 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Creating image(s)
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Ensure instance console log exists: /opt/stack/data/nova/instances/0ceb02d8-10d9-41f3-ba03-aa12de0d3d53/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Start _get_guest_xml network_info=[{"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '18a650c5-2610-4324-8325-ffe83bde3743', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0ceb02d8-10d9-41f3-ba03-aa12de0d3d53', 'attached_at': '', 'detached_at': '', 'volume_id': '82037273-a7aa-4a6e-870e-4e53bbd209fa', 'serial': '82037273-a7aa-4a6e-870e-4e53bbd209fa'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:51:50 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:51:50 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:50 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:50 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:50 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[113f4e37-e88f-4e6c-acf3-65ba06785d73]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:51:50 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad2d96f-195b-434b-93e8-74ae1b9a740c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa] added
Nov 15 05:51:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[816cd5df-b670-4a36-b75e-d0cd37c0c046]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90180b22-9894-4d8a-b926-b04a00f7e2f0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcAkOBHq {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DcAkOBHq" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[439c83be-1e85-44c5-a84f-d0b8ffdcbb6c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DcAkOBHq'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ead50ce-2bca-437f-a83f-9bb85352b5c2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3820d664-b2c5-4eb4-bc9b-a5d6518b8e87]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[461345eb-bf0b-44d3-9a27-eb362415897e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]
Nov 15 05:51:50 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.
Nov 15 05:51:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d28696a-e8ac-428e-9c7a-086a08e84f6b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[067cea9d-69af-498b-8148-3f7a689d2e8b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:51:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:50 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:51:50 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] HCTL ('38', '-', '-', 0) found on session 34 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7617da-29d0-4f0c-9e49-9015586e6233]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 34 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:51:50 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Port c5e72138-d273-4bb1-ac14-8e5f88e04114 binding to destination host user is already ACTIVE {{(pid=75648) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:51 user nova-compute[75648]: INFO nova.compute.manager [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Terminating instance
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.network.neutron [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Creating tmpfile /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/tmpu8pbh93o to verify with other compute node that the instance is on the same shared storage. {{(pid=75648) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-1f2d2319-e216-4796-8f8f-e21f349f8d4b req-4413b6d2-0d4e-438d-a6f3-471f45b287f2 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-unplugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1f2d2319-e216-4796-8f8f-e21f349f8d4b req-4413b6d2-0d4e-438d-a6f3-471f45b287f2 service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1f2d2319-e216-4796-8f8f-e21f349f8d4b req-4413b6d2-0d4e-438d-a6f3-471f45b287f2 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-1f2d2319-e216-4796-8f8f-e21f349f8d4b req-4413b6d2-0d4e-438d-a6f3-471f45b287f2 service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-1f2d2319-e216-4796-8f8f-e21f349f8d4b req-4413b6d2-0d4e-438d-a6f3-471f45b287f2 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-unplugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-1f2d2319-e216-4796-8f8f-e21f349f8d4b req-4413b6d2-0d4e-438d-a6f3-471f45b287f2 service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-unplugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23633656666623030', 'path': '/dev/sdg'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633656666623030', 'path': '/dev/sdg'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-220797488',display_name='tempest-TestVolumeBootPattern-server-220797488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-220797488',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-vqu9qsll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:51:46Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=0ceb02d8-10d9-41f3-ba03-aa12de0d3d53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:51:51 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:51:52 user nova-compute[75648]:   <uuid>0ceb02d8-10d9-41f3-ba03-aa12de0d3d53</uuid>
Nov 15 05:51:52 user nova-compute[75648]:   <name>instance-00000025</name>
Nov 15 05:51:52 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:51:52 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:51:52 user nova-compute[75648]:   <metadata>
Nov 15 05:51:52 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:51:52 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:51:52 user nova-compute[75648]:       <nova:name>tempest-TestVolumeBootPattern-server-220797488</nova:name>
Nov 15 05:51:52 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:51:50</nova:creationTime>
Nov 15 05:51:52 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:51:52 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:51:52 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:51:52 user nova-compute[75648]:       <nova:owner>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:user uuid="2fd4a8513df14fc7ab09905d24220ae1">tempest-TestVolumeBootPattern-522670763-project-member</nova:user>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:project uuid="bea832b577b9445782f27e28b1023e96">tempest-TestVolumeBootPattern-522670763</nova:project>
Nov 15 05:51:52 user nova-compute[75648]:       </nova:owner>
Nov 15 05:51:52 user nova-compute[75648]:       <nova:ports>
Nov 15 05:51:52 user nova-compute[75648]:         <nova:port uuid="83f94d30-6074-487a-a9b2-8bf156cfdc70">
Nov 15 05:51:52 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 05:51:52 user nova-compute[75648]:         </nova:port>
Nov 15 05:51:52 user nova-compute[75648]:       </nova:ports>
Nov 15 05:51:52 user nova-compute[75648]:     </nova:instance>
Nov 15 05:51:52 user nova-compute[75648]:   </metadata>
Nov 15 05:51:52 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:51:52 user nova-compute[75648]:     <system>
Nov 15 05:51:52 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:51:52 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:51:52 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:51:52 user nova-compute[75648]:       <entry name="serial">0ceb02d8-10d9-41f3-ba03-aa12de0d3d53</entry>
Nov 15 05:51:52 user nova-compute[75648]:       <entry name="uuid">0ceb02d8-10d9-41f3-ba03-aa12de0d3d53</entry>
Nov 15 05:51:52 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:51:52 user nova-compute[75648]:     </system>
Nov 15 05:51:52 user nova-compute[75648]:   </sysinfo>
Nov 15 05:51:52 user nova-compute[75648]:   <os>
Nov 15 05:51:52 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:51:52 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:51:52 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:51:52 user nova-compute[75648]:   </os>
Nov 15 05:51:52 user nova-compute[75648]:   <features>
Nov 15 05:51:52 user nova-compute[75648]:     <acpi/>
Nov 15 05:51:52 user nova-compute[75648]:     <apic/>
Nov 15 05:51:52 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:51:52 user nova-compute[75648]:   </features>
Nov 15 05:51:52 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:51:52 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:51:52 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:51:52 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:51:52 user nova-compute[75648]:   </clock>
Nov 15 05:51:52 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:51:52 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:51:52 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:51:52 user nova-compute[75648]:   </cpu>
Nov 15 05:51:52 user nova-compute[75648]:   <devices>
Nov 15 05:51:52 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:51:52 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:51:52 user nova-compute[75648]:       <source dev="/dev/sdg"/>
Nov 15 05:51:52 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:51:52 user nova-compute[75648]:       <serial>82037273-a7aa-4a6e-870e-4e53bbd209fa</serial>
Nov 15 05:51:52 user nova-compute[75648]:     </disk>
Nov 15 05:51:52 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:51:52 user nova-compute[75648]:       <mac address="fa:16:3e:60:86:ba"/>
Nov 15 05:51:52 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:51:52 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:51:52 user nova-compute[75648]:       <target dev="tap83f94d30-60"/>
Nov 15 05:51:52 user nova-compute[75648]:     </interface>
Nov 15 05:51:52 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:51:52 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/0ceb02d8-10d9-41f3-ba03-aa12de0d3d53/console.log" append="off"/>
Nov 15 05:51:52 user nova-compute[75648]:     </serial>
Nov 15 05:51:52 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:51:52 user nova-compute[75648]:     <video>
Nov 15 05:51:52 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:51:52 user nova-compute[75648]:     </video>
Nov 15 05:51:52 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:51:52 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:51:52 user nova-compute[75648]:     </rng>
Nov 15 05:51:52 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:51:52 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:51:52 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:51:52 user nova-compute[75648]:     </memballoon>
Nov 15 05:51:52 user nova-compute[75648]:   </devices>
Nov 15 05:51:52 user nova-compute[75648]: </domain>
Nov 15 05:51:52 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-220797488',display_name='tempest-TestVolumeBootPattern-server-220797488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-220797488',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-vqu9qsll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:51:46Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=0ceb02d8-10d9-41f3-ba03-aa12de0d3d53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_vif [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '73e6ef2f-b6ab-50de-926d-3a410f5a65ce', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83f94d30-60, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap83f94d30-60, col_values=(('qos', UUID('2342acc7-3bae-4563-ad29-49e6cb0612cc')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap83f94d30-60, col_values=(('external_ids', {'iface-id': '83f94d30-6074-487a-a9b2-8bf156cfdc70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:86:ba', 'vm-uuid': '0ceb02d8-10d9-41f3-ba03-aa12de0d3d53'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: INFO os_vif [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60')
Nov 15 05:51:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Instance destroyed successfully.
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lazy-loading 'resources' on Instance uuid 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:46:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-927055105',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-927055105',id=26,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGpdO5eS2Z+vf+8bBm97dhKJcYhTJoR30Qg5PfCQugizmBWklnUSX6K5d26qsw9WzbMdMr5yVpg222SDTag479q5GOTgLDgwAKc4g90Kpv0XhdH/MbODNkNmBj7SONUfbg==',key_name='tempest-keypair-1905129680',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a08f06fc4de745b589b4db3c2147e43d',ramdisk_id='',reservation_id='r-i4r0o8lf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1500760960',owner_user_name='tempest-AttachVolumeShelveTestJSON-1500760960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8bd09324c4634b8b820c49b51752a688',uuid=59e7c593-d1f7-4ebf-8fa8-b0ae91c96903,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converting VIF {"id": "7d14ba8c-00f2-4218-affc-cf872dda8026", "address": "fa:16:3e:dc:e3:c7", "network": {"id": "8c95c1c0-8283-4e8f-a59b-d0923c4275fa", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1122729756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.201", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a08f06fc4de745b589b4db3c2147e43d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d14ba8c-00", "ovs_interfaceid": "7d14ba8c-00f2-4218-affc-cf872dda8026", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_vif [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d14ba8c-00, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9b244178-2ba4-4dec-afee-f4738061184f) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No VIF found with MAC fa:16:3e:60:86:ba, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: INFO os_vif [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dc:e3:c7,bridge_name='br-int',has_traffic_filtering=True,id=7d14ba8c-00f2-4218-affc-cf872dda8026,network=Network(8c95c1c0-8283-4e8f-a59b-d0923c4275fa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d14ba8c-00')
Nov 15 05:51:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Deleting instance files /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903_del
Nov 15 05:51:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Deletion of /opt/stack/data/nova/instances/59e7c593-d1f7-4ebf-8fa8-b0ae91c96903_del complete
Nov 15 05:51:52 user nova-compute[75648]: INFO nova.compute.manager [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Took 0.77 seconds to destroy the instance on the hypervisor.
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance destroyed successfully.
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'resources' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:50:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:50:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e72138-d2, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=69e99808-c0b1-4ab8-949a-eb508eec444b) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:52 user nova-compute[75648]: INFO os_vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2')
Nov 15 05:51:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:52 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[52dcea42-5598-4614-90e6-327b0c8ae8c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:51:52 user nova-compute[75648]: No targets found.
Nov 15 05:51:52 user nova-compute[75648]: iSNS:
Nov 15 05:51:52 user nova-compute[75648]: No targets found.
Nov 15 05:51:52 user nova-compute[75648]: STATIC:
Nov 15 05:51:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:51:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:51:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:51:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64
Nov 15 05:51:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:51:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:51:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:51:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:51:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:51:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:51:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:51:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:51:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:51:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:51:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:51:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:51:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:51:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:51:52 user nova-compute[75648]: FIRMWARE:
Nov 15 05:51:52 user nova-compute[75648]: No targets found.
Nov 15 05:51:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:51:52 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:51:52 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd2100c-f63d-4b90-a03f-c5b0b9eedb53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[98864998-9a9c-4869-b963-84b43d5a5b0d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:51:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:51:52 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:51:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ae290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7844d1-9389-4202-9ac0-47ae4fd2f370]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4ced57-5dfb-45f3-a67f-32f8443b25ae]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:51:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4168dd8-0ee9-4e91-9551-6950f33c78df]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b6948-d278-4e50-a0bc-b1512e551ca2]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:51:53 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Took 0.75 seconds to deallocate network for instance.
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-93bb42d9-d236-4442-b4dc-adfa2a2bc7e4 req-5f2126f2-9fd4-4d81-9805-0ad66e9f6d0d service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-deleted-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a10f3-2d88-46b5-b0ea-20d4a2e9bc6a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6bad5d-5a7f-4d36-8c93-2c39efd67be5]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]
Nov 15 05:51:53 user nova-compute[75648]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.
Nov 15 05:51:53 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e9c2a6-30c4-4228-b6ef-10c95aa9e9a8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== disconnect_volume: return (349ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.614s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:53 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Deleted allocations for instance 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Acquiring lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] No waiting events found dispatching network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:53 user nova-compute[75648]: WARNING nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: 59e7c593-d1f7-4ebf-8fa8-b0ae91c96903] Received unexpected event network-vif-plugged-7d14ba8c-00f2-4218-affc-cf872dda8026 for instance with vm_state deleted and task_state None.
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:53 user nova-compute[75648]: WARNING nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state resized and task_state resize_reverting.
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:53 user nova-compute[75648]: WARNING nova.compute.manager [req-2d29b9b4-b5af-413c-8844-6dc75d3c2067 req-29e5ad5d-cc1d-40d0-9f69-84ce12aebaac service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state resized and task_state resize_reverting.
Nov 15 05:51:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f0df757e-1ed7-4260-982c-285c58361f9b tempest-AttachVolumeShelveTestJSON-1500760960 tempest-AttachVolumeShelveTestJSON-1500760960-project-member] Lock "59e7c593-d1f7-4ebf-8fa8-b0ae91c96903" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.408s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'migration_context' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG nova.objects.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Object Instance<cad9c255-6774-4949-940a-df74f84d3feb> lazy-loaded attributes: resources,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:51:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.504s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:54 user nova-compute[75648]: INFO nova.compute.manager [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Swapping old allocation on dict_keys(['2afde26c-116f-40d4-b607-8ec699f44de3']) held by migration 877eca90-5a78-43e0-9769-13c6076c1203 for instance
Nov 15 05:51:54 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Overwriting current allocation {'allocations': {'2afde26c-116f-40d4-b607-8ec699f44de3': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 43}}, 'project_id': '915d7e6dbaaa42bf9100917ef6ce0824', 'user_id': '306a53f7ef404302b5d26be66e11562f', 'consumer_generation': 1} on consumer cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquired lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] No waiting events found dispatching network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:55 user nova-compute[75648]: WARNING nova.compute.manager [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received unexpected event network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 for instance with vm_state building and task_state spawning.
Nov 15 05:51:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] No waiting events found dispatching network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:51:55 user nova-compute[75648]: WARNING nova.compute.manager [req-a04e505e-754b-42b7-a7f3-bf7ce591898a req-e7c45961-a596-4e26-b432-2c8d9c0cd12b service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received unexpected event network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 for instance with vm_state building and task_state spawning.
Nov 15 05:51:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Releasing lock "refresh_cache-cad9c255-6774-4949-940a-df74f84d3feb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG os_brick.utils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[adda2b95-85ae-4d7c-8863-6e6b969f666d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed6a9c3-2782-4366-9d19-5e4d0f38a9ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f89da24-ad1f-4c51-942a-be3bc4137ef6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f27217-0c58-4b7d-ab0a-bce7aee35370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:51:55 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:51:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0220c5-46bf-485f-bd4f-ba2805e06e46]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:51:55 user nova-compute[75648]: DEBUG os_brick.utils [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:51:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Instance spawned successfully.
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:51:56 user nova-compute[75648]: INFO nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 15 05:51:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:51:56 user nova-compute[75648]: INFO nova.compute.manager [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Took 11.27 seconds to build instance.
Nov 15 05:51:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2c8045a6-46b5-4c51-b440-84aa5b24c8e8 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.361s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:57 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:57 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:51:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:51:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:51:57 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:51:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:58 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:51:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Starting finish_revert_migration {{(pid=75648) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start _get_guest_xml network_info=[{"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'bc504b3a-03a1-4666-821c-641d5d299ffb', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'cad9c255-6774-4949-940a-df74f84d3feb', 'attached_at': '2023-11-15T05:52:01.000000', 'detached_at': '', 'volume_id': '50879f6c-d4f9-45d9-b06a-e176925f814d', 'serial': '50879f6c-d4f9-45d9-b06a-e176925f814d'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:52:00 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:52:00 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.objects.instance [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'vcpu_model' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:52:00 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:52:00 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:52:00 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[35afd64e-b0fc-4b83-9235-c66266c43b6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:52:00 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.070s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bd3948-d8ed-4317-bcae-dd7d277ec0aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d] added
Nov 15 05:52:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93220abd-8cd2-4aad-96f1-21abe287c904]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fab582-fe2d-4653-bdbd-c459aab5f389]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUVYEDj {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PTUVYEDj" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ef97d8-a89a-432c-842a-7ea83f0fb5a1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PTUVYEDj'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e96eeed-6413-4f10-a639-f70c513451f7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[689c945f-638a-4487-a5f9-88959b3fd12a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea559107-1dde-4f3c-b264-a70c9d2a6f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]
Nov 15 05:52:01 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.
Nov 15 05:52:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3e2519-c687-4e81-840a-ec506df4d30a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[983b993e-a3d2-4c1c-b5a6-72a542a95452]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:52:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:01 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:52:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] HCTL ('35', '-', '-', 0) found on session 35 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd76094d-ef99-4861-b7bd-9914bfaec170]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Searching for a device in session 35 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.486s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== connect_volume: return (1489ms) {'type': 'block', 'scsi_wwn': '23330616236353531', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330616236353531', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:50:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:51:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:52:02 user nova-compute[75648]:   <uuid>cad9c255-6774-4949-940a-df74f84d3feb</uuid>
Nov 15 05:52:02 user nova-compute[75648]:   <name>instance-00000019</name>
Nov 15 05:52:02 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:52:02 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:52:02 user nova-compute[75648]:   <metadata>
Nov 15 05:52:02 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:52:02 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:52:02 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherB-server-2035674182</nova:name>
Nov 15 05:52:02 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:52:00</nova:creationTime>
Nov 15 05:52:02 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:52:02 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:52:02 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:52:02 user nova-compute[75648]:       <nova:owner>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:user uuid="306a53f7ef404302b5d26be66e11562f">tempest-ServerActionsTestOtherB-1116144874-project-member</nova:user>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:project uuid="915d7e6dbaaa42bf9100917ef6ce0824">tempest-ServerActionsTestOtherB-1116144874</nova:project>
Nov 15 05:52:02 user nova-compute[75648]:       </nova:owner>
Nov 15 05:52:02 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:52:02 user nova-compute[75648]:       <nova:ports>
Nov 15 05:52:02 user nova-compute[75648]:         <nova:port uuid="c5e72138-d273-4bb1-ac14-8e5f88e04114">
Nov 15 05:52:02 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:52:02 user nova-compute[75648]:         </nova:port>
Nov 15 05:52:02 user nova-compute[75648]:       </nova:ports>
Nov 15 05:52:02 user nova-compute[75648]:     </nova:instance>
Nov 15 05:52:02 user nova-compute[75648]:   </metadata>
Nov 15 05:52:02 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:52:02 user nova-compute[75648]:     <system>
Nov 15 05:52:02 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:52:02 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:52:02 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:52:02 user nova-compute[75648]:       <entry name="serial">cad9c255-6774-4949-940a-df74f84d3feb</entry>
Nov 15 05:52:02 user nova-compute[75648]:       <entry name="uuid">cad9c255-6774-4949-940a-df74f84d3feb</entry>
Nov 15 05:52:02 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:52:02 user nova-compute[75648]:     </system>
Nov 15 05:52:02 user nova-compute[75648]:   </sysinfo>
Nov 15 05:52:02 user nova-compute[75648]:   <os>
Nov 15 05:52:02 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:52:02 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:52:02 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:52:02 user nova-compute[75648]:   </os>
Nov 15 05:52:02 user nova-compute[75648]:   <features>
Nov 15 05:52:02 user nova-compute[75648]:     <acpi/>
Nov 15 05:52:02 user nova-compute[75648]:     <apic/>
Nov 15 05:52:02 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:52:02 user nova-compute[75648]:   </features>
Nov 15 05:52:02 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:52:02 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:52:02 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:52:02 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:52:02 user nova-compute[75648]:   </clock>
Nov 15 05:52:02 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:52:02 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:52:02 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:52:02 user nova-compute[75648]:   </cpu>
Nov 15 05:52:02 user nova-compute[75648]:   <devices>
Nov 15 05:52:02 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:52:02 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:52:02 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk"/>
Nov 15 05:52:02 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:52:02 user nova-compute[75648]:     </disk>
Nov 15 05:52:02 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:52:02 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:52:02 user nova-compute[75648]:       <source dev="/dev/sdd"/>
Nov 15 05:52:02 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:52:02 user nova-compute[75648]:       <serial>50879f6c-d4f9-45d9-b06a-e176925f814d</serial>
Nov 15 05:52:02 user nova-compute[75648]:     </disk>
Nov 15 05:52:02 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:52:02 user nova-compute[75648]:       <mac address="fa:16:3e:9a:5e:31"/>
Nov 15 05:52:02 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:52:02 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:52:02 user nova-compute[75648]:       <target dev="tapc5e72138-d2"/>
Nov 15 05:52:02 user nova-compute[75648]:     </interface>
Nov 15 05:52:02 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:52:02 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/console.log" append="off"/>
Nov 15 05:52:02 user nova-compute[75648]:     </serial>
Nov 15 05:52:02 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:52:02 user nova-compute[75648]:     <video>
Nov 15 05:52:02 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:52:02 user nova-compute[75648]:     </video>
Nov 15 05:52:02 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:52:02 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:52:02 user nova-compute[75648]:     </rng>
Nov 15 05:52:02 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:52:02 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:52:02 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:52:02 user nova-compute[75648]:     </memballoon>
Nov 15 05:52:02 user nova-compute[75648]:   </devices>
Nov 15 05:52:02 user nova-compute[75648]: </domain>
Nov 15 05:52:02 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:50:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:51:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG os_vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b723c82c-ed01-5f95-b64b-066cc4061458', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5e72138-d2, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc5e72138-d2, col_values=(('qos', UUID('7aaaf0b3-9e50-455a-a31f-091fc24aeace')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc5e72138-d2, col_values=(('external_ids', {'iface-id': 'c5e72138-d273-4bb1-ac14-8e5f88e04114', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:5e:31', 'vm-uuid': 'cad9c255-6774-4949-940a-df74f84d3feb'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:02 user nova-compute[75648]: INFO os_vif [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2')
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-487804bc-50d0-42d2-8f96-69717fe84c28 req-da8cc082-be98-4a53-80d4-0e647f1b654c service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-487804bc-50d0-42d2-8f96-69717fe84c28 req-da8cc082-be98-4a53-80d4-0e647f1b654c service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-487804bc-50d0-42d2-8f96-69717fe84c28 req-da8cc082-be98-4a53-80d4-0e647f1b654c service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-487804bc-50d0-42d2-8f96-69717fe84c28 req-da8cc082-be98-4a53-80d4-0e647f1b654c service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-487804bc-50d0-42d2-8f96-69717fe84c28 req-da8cc082-be98-4a53-80d4-0e647f1b654c service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:52:06 user nova-compute[75648]: WARNING nova.compute.manager [req-487804bc-50d0-42d2-8f96-69717fe84c28 req-da8cc082-be98-4a53-80d4-0e647f1b654c service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state resized and task_state resize_reverting.
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-25e64bec-7580-491c-918f-b18982c7a8c5 req-4a403e13-2474-4a19-89e1-26e3aafb45a6 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-25e64bec-7580-491c-918f-b18982c7a8c5 req-4a403e13-2474-4a19-89e1-26e3aafb45a6 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-25e64bec-7580-491c-918f-b18982c7a8c5 req-4a403e13-2474-4a19-89e1-26e3aafb45a6 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-25e64bec-7580-491c-918f-b18982c7a8c5 req-4a403e13-2474-4a19-89e1-26e3aafb45a6 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-25e64bec-7580-491c-918f-b18982c7a8c5 req-4a403e13-2474-4a19-89e1-26e3aafb45a6 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:52:06 user nova-compute[75648]: WARNING nova.compute.manager [req-25e64bec-7580-491c-918f-b18982c7a8c5 req-4a403e13-2474-4a19-89e1-26e3aafb45a6 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state resized and task_state resize_reverting.
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:52:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance running successfully.
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] finish_revert_migration finished successfully. {{(pid=75648) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 15 05:52:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:52:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7403MB free_disk=24.940582275390625GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 878ae6df-048e-4181-895e-64ad390935dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5b473790-b699-419b-81be-b36b42f6ba5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 64004f1c-2f3f-4d02-8632-823a13493b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:52:06 user nova-compute[75648]: INFO nova.compute.manager [None req-aa36d947-d1e9-47ca-8b5e-2e2ce95d360f tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance to original state: 'active'
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:52:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:52:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:52:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:52:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:52:25 user nova-compute[75648]: INFO nova.compute.claims [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Claim successful on node user
Nov 15 05:52:25 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:52:25 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:52:26 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.policy [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d61be40c2864afc99cd689efdb30308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06bd3ce1caf14075b2d936ac45b143f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:52:26 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Creating image(s)
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.214s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.298s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Successfully created port: 738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk 1073741824" returned: 0 in 0.069s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.373s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.202s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Cannot resize image /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Ensure instance console log exists: /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Successfully updated port: 738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquired lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-changed-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Refreshing instance network info cache due to event network-changed-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] Acquiring lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updating instance_info_cache with network_info: [{"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Releasing lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance network_info: |[{"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] Acquired lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.neutron [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Refreshing network info cache for port 738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Start _get_guest_xml network_info=[{"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:52:27 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:52:27 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1132664164',display_name='tempest-tempest.common.compute-instance-1132664164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1132664164',id=38,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrMHw6CVN46QndV4fLK/dkMsjkjJ2ANmwSPlQ0Jykvkn/AVvRx4HXNbGOOm/kpUKJjPVSvEqRr9l81gzdL3tBchJJzfye99ufgHezNwSfzUqXQBsIlWt9CtZzqyBs17ag==',key_name='tempest-keypair-822930759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-ch1ya3rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=cfba25df-06bc-4064-a681-e39c39bff579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'pci_devices' on Instance uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:52:27 user nova-compute[75648]:   <uuid>cfba25df-06bc-4064-a681-e39c39bff579</uuid>
Nov 15 05:52:27 user nova-compute[75648]:   <name>instance-00000026</name>
Nov 15 05:52:27 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:52:27 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:52:27 user nova-compute[75648]:   <metadata>
Nov 15 05:52:27 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:52:27 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:52:27 user nova-compute[75648]:       <nova:name>tempest-tempest.common.compute-instance-1132664164</nova:name>
Nov 15 05:52:27 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:52:27</nova:creationTime>
Nov 15 05:52:27 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:52:27 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:52:27 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:52:27 user nova-compute[75648]:       <nova:owner>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:user uuid="5d61be40c2864afc99cd689efdb30308">tempest-ServerActionsTestOtherA-442850377-project-member</nova:user>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:project uuid="06bd3ce1caf14075b2d936ac45b143f5">tempest-ServerActionsTestOtherA-442850377</nova:project>
Nov 15 05:52:27 user nova-compute[75648]:       </nova:owner>
Nov 15 05:52:27 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:52:27 user nova-compute[75648]:       <nova:ports>
Nov 15 05:52:27 user nova-compute[75648]:         <nova:port uuid="738f8ceb-3e09-4e7e-a54a-a6118d6df7ec">
Nov 15 05:52:27 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 05:52:27 user nova-compute[75648]:         </nova:port>
Nov 15 05:52:27 user nova-compute[75648]:       </nova:ports>
Nov 15 05:52:27 user nova-compute[75648]:     </nova:instance>
Nov 15 05:52:27 user nova-compute[75648]:   </metadata>
Nov 15 05:52:27 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:52:27 user nova-compute[75648]:     <system>
Nov 15 05:52:27 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:52:27 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:52:27 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:52:27 user nova-compute[75648]:       <entry name="serial">cfba25df-06bc-4064-a681-e39c39bff579</entry>
Nov 15 05:52:27 user nova-compute[75648]:       <entry name="uuid">cfba25df-06bc-4064-a681-e39c39bff579</entry>
Nov 15 05:52:27 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:52:27 user nova-compute[75648]:     </system>
Nov 15 05:52:27 user nova-compute[75648]:   </sysinfo>
Nov 15 05:52:27 user nova-compute[75648]:   <os>
Nov 15 05:52:27 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:52:27 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:52:27 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:52:27 user nova-compute[75648]:   </os>
Nov 15 05:52:27 user nova-compute[75648]:   <features>
Nov 15 05:52:27 user nova-compute[75648]:     <acpi/>
Nov 15 05:52:27 user nova-compute[75648]:     <apic/>
Nov 15 05:52:27 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:52:27 user nova-compute[75648]:   </features>
Nov 15 05:52:27 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:52:27 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:52:27 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:52:27 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:52:27 user nova-compute[75648]:   </clock>
Nov 15 05:52:27 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:52:27 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:52:27 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:52:27 user nova-compute[75648]:   </cpu>
Nov 15 05:52:27 user nova-compute[75648]:   <devices>
Nov 15 05:52:27 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:52:27 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:52:27 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk"/>
Nov 15 05:52:27 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:52:27 user nova-compute[75648]:     </disk>
Nov 15 05:52:27 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:52:27 user nova-compute[75648]:       <mac address="fa:16:3e:24:1c:02"/>
Nov 15 05:52:27 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:52:27 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:52:27 user nova-compute[75648]:       <target dev="tap738f8ceb-3e"/>
Nov 15 05:52:27 user nova-compute[75648]:     </interface>
Nov 15 05:52:27 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:52:27 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/console.log" append="off"/>
Nov 15 05:52:27 user nova-compute[75648]:     </serial>
Nov 15 05:52:27 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:52:27 user nova-compute[75648]:     <video>
Nov 15 05:52:27 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:52:27 user nova-compute[75648]:     </video>
Nov 15 05:52:27 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:52:27 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:52:27 user nova-compute[75648]:     </rng>
Nov 15 05:52:27 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:52:27 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:52:27 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:52:27 user nova-compute[75648]:     </memballoon>
Nov 15 05:52:27 user nova-compute[75648]:   </devices>
Nov 15 05:52:27 user nova-compute[75648]: </domain>
Nov 15 05:52:27 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1132664164',display_name='tempest-tempest.common.compute-instance-1132664164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1132664164',id=38,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrMHw6CVN46QndV4fLK/dkMsjkjJ2ANmwSPlQ0Jykvkn/AVvRx4HXNbGOOm/kpUKJjPVSvEqRr9l81gzdL3tBchJJzfye99ufgHezNwSfzUqXQBsIlWt9CtZzqyBs17ag==',key_name='tempest-keypair-822930759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-ch1ya3rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:52:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=cfba25df-06bc-4064-a681-e39c39bff579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG os_vif [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d7989e6-7fbf-52ca-b07e-63214d82bbbc', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap738f8ceb-3e, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap738f8ceb-3e, col_values=(('qos', UUID('d67ff762-bf12-43f0-ae50-5b61cfb0994f')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap738f8ceb-3e, col_values=(('external_ids', {'iface-id': '738f8ceb-3e09-4e7e-a54a-a6118d6df7ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:1c:02', 'vm-uuid': 'cfba25df-06bc-4064-a681-e39c39bff579'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:52:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:27 user nova-compute[75648]: INFO os_vif [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e')
Nov 15 05:52:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:52:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No VIF found with MAC fa:16:3e:24:1c:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:52:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updated VIF entry in instance network info cache for port 738f8ceb-3e09-4e7e-a54a-a6118d6df7ec. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:52:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updating instance_info_cache with network_info: [{"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:52:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-874ba623-8337-48ea-a883-59134fc96000 req-cde29c72-c0a9-4e2b-8306-4885a02afc01 service nova] Releasing lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-838c5177-e97c-4acb-b713-7bc75e2b608e req-ea2593c7-f2f8-46ee-a5eb-99115976c3e9 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-838c5177-e97c-4acb-b713-7bc75e2b608e req-ea2593c7-f2f8-46ee-a5eb-99115976c3e9 service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-838c5177-e97c-4acb-b713-7bc75e2b608e req-ea2593c7-f2f8-46ee-a5eb-99115976c3e9 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-838c5177-e97c-4acb-b713-7bc75e2b608e req-ea2593c7-f2f8-46ee-a5eb-99115976c3e9 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-838c5177-e97c-4acb-b713-7bc75e2b608e req-ea2593c7-f2f8-46ee-a5eb-99115976c3e9 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:52:29 user nova-compute[75648]: WARNING nova.compute.manager [req-838c5177-e97c-4acb-b713-7bc75e2b608e req-ea2593c7-f2f8-46ee-a5eb-99115976c3e9 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state building and task_state spawning.
Nov 15 05:52:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:52:31 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance spawned successfully.
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:52:31 user nova-compute[75648]: INFO nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-60de3064-d8be-4c3b-a9c6-d7f3154daeaa req-b658fe67-630f-42a4-bb15-a3c64d087532 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-60de3064-d8be-4c3b-a9c6-d7f3154daeaa req-b658fe67-630f-42a4-bb15-a3c64d087532 service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-60de3064-d8be-4c3b-a9c6-d7f3154daeaa req-b658fe67-630f-42a4-bb15-a3c64d087532 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-60de3064-d8be-4c3b-a9c6-d7f3154daeaa req-b658fe67-630f-42a4-bb15-a3c64d087532 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-60de3064-d8be-4c3b-a9c6-d7f3154daeaa req-b658fe67-630f-42a4-bb15-a3c64d087532 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:52:31 user nova-compute[75648]: WARNING nova.compute.manager [req-60de3064-d8be-4c3b-a9c6-d7f3154daeaa req-b658fe67-630f-42a4-bb15-a3c64d087532 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state building and task_state spawning.
Nov 15 05:52:31 user nova-compute[75648]: INFO nova.compute.manager [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Took 6.18 seconds to build instance.
Nov 15 05:52:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4f84b96e-85f4-464d-a5cd-fdb635df9b98 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.271s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-changed-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Refreshing instance network info cache due to event network-changed-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] Acquiring lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] Acquired lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Refreshing network info cache for port f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:52:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG nova.objects.instance [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'flavor' on Instance uuid 5b473790-b699-419b-81be-b36b42f6ba5a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:52:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Ignoring supplied device name: /dev/vdb
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:43 user nova-compute[75648]: INFO nova.compute.manager [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Attaching volume 65c10648-dcf8-43e5-80bd-d53730c094bd to /dev/vdb
Nov 15 05:52:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updated VIF entry in instance network info cache for port f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updating instance_info_cache with network_info: [{"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e33fe262-02f1-422b-bd36-e0ca9a05a81e req-20365353-9e74-4e28-8cd2-6a51f4371221 service nova] Releasing lock "refresh_cache-5b473790-b699-419b-81be-b36b42f6ba5a" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG os_brick.utils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b19cefa-294b-4cc1-9206-aebda2022fb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7707c712-6f6a-4b5c-8199-876ba77f7b41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9a4570-bf7c-4e59-b69d-a80171fac964]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b841fb99-d512-4e2c-8479-ddc6554a3efc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:52:43 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:52:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbb4d1c9-e62f-4549-bfb3-12691bdccede]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG os_brick.utils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:52:43 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updating existing volume attachment record: 35328ccf-6101-40e1-8c78-1ecf5459ccae {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:52:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHtIZBxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:52:48 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:52:48 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:52:48 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:52:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca27b19-69b9-4609-9e1d-4e810e677c9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:52:48 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd9664c-debf-4334-a5af-7547cf935239]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd] added
Nov 15 05:52:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2bf66b-e3f8-4aff-9fce-fdacfbdb05d6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e873f8-654d-4ccc-ac1e-c4178733423f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHtIZBxE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHtIZBxE" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c445f262-096e-4d19-bc9a-e613bca5300e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHtIZBxE'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[194331d6-8f0d-4e9a-8856-1a1537abb6f3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cf110e-f4e5-4681-80ae-93e247bc2490]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:52:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:52:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db73cb-add6-444a-b7a8-ab7ab7fa7da4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260]
Nov 15 05:52:48 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260] successful.
Nov 15 05:52:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab1974a-a363-4139-9423-0a0729eb79b0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a5e8e8-65d7-42ff-b0b3-0af9c229954f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)
Nov 15 05:52:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:52:48 user nova-compute[75648]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)
Nov 15 05:52:48 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] HCTL ('39', '-', '-', 0) found on session 36 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de17ff0-890b-4196-8887-2ea69dcc9b68]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:52:48 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Searching for a device in session 36 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHtIZBxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23561393336313963', 'path': '/dev/sdh'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561393336313963', 'path': '/dev/sdh'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG nova.objects.instance [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'flavor' on Instance uuid 5b473790-b699-419b-81be-b36b42f6ba5a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:52:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:52:49 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:52:49 user nova-compute[75648]:   <source dev="/dev/sdh"/>
Nov 15 05:52:49 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:52:49 user nova-compute[75648]:   <serial>65c10648-dcf8-43e5-80bd-d53730c094bd</serial>
Nov 15 05:52:49 user nova-compute[75648]: </disk>
Nov 15 05:52:49 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:52:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:52:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:52:50 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] No VIF found with MAC fa:16:3e:ca:a2:22, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:52:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9237fa8e-3695-4ec2-b028-2c1b445179da tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.837s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:52:50 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:52:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:53 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:52:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:57 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:52:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:52:58 user nova-compute[75648]: INFO nova.compute.manager [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Detaching volume 65c10648-dcf8-43e5-80bd-d53730c094bd
Nov 15 05:52:58 user nova-compute[75648]: INFO nova.virt.block_device [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Attempting to driver detach volume 65c10648-dcf8-43e5-80bd-d53730c094bd from mountpoint /dev/vdb
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Attempting to detach device vdb from instance 5b473790-b699-419b-81be-b36b42f6ba5a from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:52:58 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:52:58 user nova-compute[75648]:   <source dev="/dev/sdh"/>
Nov 15 05:52:58 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:52:58 user nova-compute[75648]:   <serial>65c10648-dcf8-43e5-80bd-d53730c094bd</serial>
Nov 15 05:52:58 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:52:58 user nova-compute[75648]: </disk>
Nov 15 05:52:58 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:52:58 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully detached device vdb from instance 5b473790-b699-419b-81be-b36b42f6ba5a from the persistent domain config.
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5b473790-b699-419b-81be-b36b42f6ba5a from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:52:58 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:52:58 user nova-compute[75648]:   <source dev="/dev/sdh"/>
Nov 15 05:52:58 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:52:58 user nova-compute[75648]:   <serial>65c10648-dcf8-43e5-80bd-d53730c094bd</serial>
Nov 15 05:52:58 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:52:58 user nova-compute[75648]: </disk>
Nov 15 05:52:58 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:52:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5b473790-b699-419b-81be-b36b42f6ba5a {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:52:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [{"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:52:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-50d2b30f-82e8-46fe-8a7b-f227ba756995" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:52:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:52:59 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:53:01 user nova-compute[75648]: INFO nova.compute.claims [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Claim successful on node user
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.671s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:53:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.policy [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f995cb1428a414d91dd043e1c53d130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06304608934649daab8dc8e603b9a446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:53:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Creating image(s)
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk 1073741824" returned: 0 in 0.056s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Successfully created port: da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Cannot resize image /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Ensure instance console log exists: /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Successfully updated port: da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquired lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-changed-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.compute.manager [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Refreshing instance network info cache due to event network-changed-da0d7513-b660-42e8-9bfd-fcaa36bdff7f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] Acquiring lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updating instance_info_cache with network_info: [{"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Releasing lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Instance network_info: |[{"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] Acquired lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.neutron [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Refreshing network info cache for port da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Start _get_guest_xml network_info=[{"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:04 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:04 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-116234881',display_name='tempest-AttachVolumeNegativeTest-server-116234881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-116234881',id=39,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3vg5fEpUBNKJY/6O0AJM0Hp8daStwfNGFTghRbwqSXJ+IHEc5X+V14QFYKoCEJ6qPHELCR1AkOx/DOkjBT2WEHHAHOgWnEOJhWMvr3zFwZzRqxtJnFLcQQjKqqUAutOg==',key_name='tempest-keypair-1224580510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-499gnqbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=7b7a666d-f7cb-4550-a21b-f843323e40e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.objects.instance [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:53:04 user nova-compute[75648]:   <uuid>7b7a666d-f7cb-4550-a21b-f843323e40e0</uuid>
Nov 15 05:53:04 user nova-compute[75648]:   <name>instance-00000027</name>
Nov 15 05:53:04 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:53:04 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:53:04 user nova-compute[75648]:   <metadata>
Nov 15 05:53:04 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:53:04 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:53:04 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeNegativeTest-server-116234881</nova:name>
Nov 15 05:53:04 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:53:04</nova:creationTime>
Nov 15 05:53:04 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:53:04 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:53:04 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:53:04 user nova-compute[75648]:       <nova:owner>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:user uuid="8f995cb1428a414d91dd043e1c53d130">tempest-AttachVolumeNegativeTest-2114996187-project-member</nova:user>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:project uuid="06304608934649daab8dc8e603b9a446">tempest-AttachVolumeNegativeTest-2114996187</nova:project>
Nov 15 05:53:04 user nova-compute[75648]:       </nova:owner>
Nov 15 05:53:04 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:53:04 user nova-compute[75648]:       <nova:ports>
Nov 15 05:53:04 user nova-compute[75648]:         <nova:port uuid="da0d7513-b660-42e8-9bfd-fcaa36bdff7f">
Nov 15 05:53:04 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 05:53:04 user nova-compute[75648]:         </nova:port>
Nov 15 05:53:04 user nova-compute[75648]:       </nova:ports>
Nov 15 05:53:04 user nova-compute[75648]:     </nova:instance>
Nov 15 05:53:04 user nova-compute[75648]:   </metadata>
Nov 15 05:53:04 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:53:04 user nova-compute[75648]:     <system>
Nov 15 05:53:04 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:53:04 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:53:04 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:53:04 user nova-compute[75648]:       <entry name="serial">7b7a666d-f7cb-4550-a21b-f843323e40e0</entry>
Nov 15 05:53:04 user nova-compute[75648]:       <entry name="uuid">7b7a666d-f7cb-4550-a21b-f843323e40e0</entry>
Nov 15 05:53:04 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:53:04 user nova-compute[75648]:     </system>
Nov 15 05:53:04 user nova-compute[75648]:   </sysinfo>
Nov 15 05:53:04 user nova-compute[75648]:   <os>
Nov 15 05:53:04 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:53:04 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:53:04 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:53:04 user nova-compute[75648]:   </os>
Nov 15 05:53:04 user nova-compute[75648]:   <features>
Nov 15 05:53:04 user nova-compute[75648]:     <acpi/>
Nov 15 05:53:04 user nova-compute[75648]:     <apic/>
Nov 15 05:53:04 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:53:04 user nova-compute[75648]:   </features>
Nov 15 05:53:04 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:53:04 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:53:04 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:53:04 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:53:04 user nova-compute[75648]:   </clock>
Nov 15 05:53:04 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:53:04 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:53:04 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:53:04 user nova-compute[75648]:   </cpu>
Nov 15 05:53:04 user nova-compute[75648]:   <devices>
Nov 15 05:53:04 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:53:04 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:53:04 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk"/>
Nov 15 05:53:04 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:53:04 user nova-compute[75648]:     </disk>
Nov 15 05:53:04 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:53:04 user nova-compute[75648]:       <mac address="fa:16:3e:37:5c:91"/>
Nov 15 05:53:04 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:53:04 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:53:04 user nova-compute[75648]:       <target dev="tapda0d7513-b6"/>
Nov 15 05:53:04 user nova-compute[75648]:     </interface>
Nov 15 05:53:04 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:53:04 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/console.log" append="off"/>
Nov 15 05:53:04 user nova-compute[75648]:     </serial>
Nov 15 05:53:04 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:53:04 user nova-compute[75648]:     <video>
Nov 15 05:53:04 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:53:04 user nova-compute[75648]:     </video>
Nov 15 05:53:04 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:53:04 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:53:04 user nova-compute[75648]:     </rng>
Nov 15 05:53:04 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:53:04 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:53:04 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:53:04 user nova-compute[75648]:     </memballoon>
Nov 15 05:53:04 user nova-compute[75648]:   </devices>
Nov 15 05:53:04 user nova-compute[75648]: </domain>
Nov 15 05:53:04 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-116234881',display_name='tempest-AttachVolumeNegativeTest-server-116234881',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-116234881',id=39,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3vg5fEpUBNKJY/6O0AJM0Hp8daStwfNGFTghRbwqSXJ+IHEc5X+V14QFYKoCEJ6qPHELCR1AkOx/DOkjBT2WEHHAHOgWnEOJhWMvr3zFwZzRqxtJnFLcQQjKqqUAutOg==',key_name='tempest-keypair-1224580510',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-499gnqbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=7b7a666d-f7cb-4550-a21b-f843323e40e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG os_vif [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ab7cc8e-5ad3-5278-aaa7-b75ae6e6d6b1', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda0d7513-b6, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda0d7513-b6, col_values=(('qos', UUID('93b67c91-684e-4afc-91b8-fcda017c5cff')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda0d7513-b6, col_values=(('external_ids', {'iface-id': 'da0d7513-b660-42e8-9bfd-fcaa36bdff7f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:5c:91', 'vm-uuid': '7b7a666d-f7cb-4550-a21b-f843323e40e0'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:53:04 user nova-compute[75648]: INFO nova.compute.manager [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Rescuing
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:04 user nova-compute[75648]: INFO os_vif [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6')
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:37:5c:91, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:53:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updating instance_info_cache with network_info: [{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updated VIF entry in instance network info cache for port da0d7513-b660-42e8-9bfd-fcaa36bdff7f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updating instance_info_cache with network_info: [{"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ac6cac8c-eb81-4cf8-95e2-1b068950c0ef req-bb90fbf4-bd2f-4051-8c01-8f2586b5d6c7 service nova] Releasing lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-a2c7343e-19af-47b9-ae4c-43fba68794e7 req-3c11c4c3-4ad5-471c-8c8a-b8f0187bfb8b service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a2c7343e-19af-47b9-ae4c-43fba68794e7 req-3c11c4c3-4ad5-471c-8c8a-b8f0187bfb8b service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a2c7343e-19af-47b9-ae4c-43fba68794e7 req-3c11c4c3-4ad5-471c-8c8a-b8f0187bfb8b service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a2c7343e-19af-47b9-ae4c-43fba68794e7 req-3c11c4c3-4ad5-471c-8c8a-b8f0187bfb8b service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-a2c7343e-19af-47b9-ae4c-43fba68794e7 req-3c11c4c3-4ad5-471c-8c8a-b8f0187bfb8b service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:05 user nova-compute[75648]: WARNING nova.compute.manager [req-a2c7343e-19af-47b9-ae4c-43fba68794e7 req-3c11c4c3-4ad5-471c-8c8a-b8f0187bfb8b service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state active and task_state rescuing.
Nov 15 05:53:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7128MB free_disk=24.936668395996094GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-changed-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.compute.manager [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing instance network info cache due to event network-changed-3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG nova.network.neutron [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing network info cache for port 3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:05 user nova-compute[75648]: INFO nova.compute.manager [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Detaching volume ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:53:05 user nova-compute[75648]: INFO nova.virt.block_device [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Attempting to driver detach volume ac36aea3-30c2-4cd1-a805-cc07d1c5e596 from mountpoint /dev/vdb
Nov 15 05:53:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Attempting to detach device vdb from instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:53:06 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:53:06 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:53:06 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:53:06 user nova-compute[75648]:   <serial>ac36aea3-30c2-4cd1-a805-cc07d1c5e596</serial>
Nov 15 05:53:06 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:53:06 user nova-compute[75648]: </disk>
Nov 15 05:53:06 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully detached device vdb from instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 from the persistent domain config.
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:53:06 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:53:06 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:53:06 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:53:06 user nova-compute[75648]:   <serial>ac36aea3-30c2-4cd1-a805-cc07d1c5e596</serial>
Nov 15 05:53:06 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:53:06 user nova-compute[75648]: </disk>
Nov 15 05:53:06 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 878ae6df-048e-4181-895e-64ad390935dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 5b473790-b699-419b-81be-b36b42f6ba5a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 64004f1c-2f3f-4d02-8632-823a13493b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cfba25df-06bc-4064-a681-e39c39bff579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.677s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:53:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance destroyed successfully.
Nov 15 05:53:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Attempting a stable device rescue
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75648) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 05:53:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Creating image(s)
Nov 15 05:53:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "/opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "/opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'trusted_certs' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "9fc9116a02ae19fd286203f16621e8b413d4f7dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "9fc9116a02ae19fd286203f16621e8b413d4f7dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.part --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updated VIF entry in instance network info cache for port 3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-95fc1162-37c6-442c-a226-c5596762e542 req-7c5f90d6-6d89-4e91-af86-3d638169f2a5 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-95fc1162-37c6-442c-a226-c5596762e542 req-7c5f90d6-6d89-4e91-af86-3d638169f2a5 service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-95fc1162-37c6-442c-a226-c5596762e542 req-7c5f90d6-6d89-4e91-af86-3d638169f2a5 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-95fc1162-37c6-442c-a226-c5596762e542 req-7c5f90d6-6d89-4e91-af86-3d638169f2a5 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-95fc1162-37c6-442c-a226-c5596762e542 req-7c5f90d6-6d89-4e91-af86-3d638169f2a5 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:08 user nova-compute[75648]: WARNING nova.compute.manager [req-95fc1162-37c6-442c-a226-c5596762e542 req-7c5f90d6-6d89-4e91-af86-3d638169f2a5 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state active and task_state rescuing.
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] No waiting events found dispatching network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:08 user nova-compute[75648]: WARNING nova.compute.manager [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received unexpected event network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f for instance with vm_state building and task_state spawning.
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] No waiting events found dispatching network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:08 user nova-compute[75648]: WARNING nova.compute.manager [req-0776ff71-8bb9-458b-908f-2157c7d0c529 req-5086e4e1-8350-4429-8106-49651f3325a8 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received unexpected event network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f for instance with vm_state building and task_state spawning.
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-changed-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing instance network info cache due to event network-changed-3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] Acquiring lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] Acquired lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Refreshing network info cache for port 3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.part --force-share --output=json" returned: 0 in 0.435s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.virt.images [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] 54730fc5-2869-4a6a-84bb-72414160a368 was qcow2, converting to raw {{(pid=75648) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.privsep.utils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75648) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.part /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.converted {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updated VIF entry in instance network info cache for port 3a03d778-0782-478e-b330-30ad6415e732. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [{"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ce9ea8b-5d78-4be1-860c-a0da65394eaf req-b10524a1-befe-4f26-813b-f394ee3158bb service nova] Releasing lock "refresh_cache-2fe5ece1-e20e-432d-9af8-976dc679dea5" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:53:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Instance spawned successfully.
Nov 15 05:53:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.part /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.converted" returned: 0 in 0.610s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.converted --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:09 user nova-compute[75648]: INFO nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Took 6.53 seconds to spawn the instance on the hypervisor.
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "9fc9116a02ae19fd286203f16621e8b413d4f7dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.567s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "9fc9116a02ae19fd286203f16621e8b413d4f7dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "9fc9116a02ae19fd286203f16621e8b413d4f7dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: INFO nova.compute.manager [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Took 7.69 seconds to build instance.
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-52c05640-9326-4bff-b8ea-d0c43ac0e6c1 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.790s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd,backing_fmt=raw /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd,backing_fmt=raw /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue" returned: 0 in 0.066s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "9fc9116a02ae19fd286203f16621e8b413d4f7dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'migration_context' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<64004f1c-2f3f-4d02-8632-823a13493b17> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Start _get_guest_xml network_info=[{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "vif_mac": "fa:16:3e:e9:99:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '54730fc5-2869-4a6a-84bb-72414160a368', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '30c288a2-cbdf-4c0c-9b6a-45c02919fd9b', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '64004f1c-2f3f-4d02-8632-823a13493b17', 'attached_at': '', 'detached_at': '', 'volume_id': '4fa6f397-6fd1-4288-8d83-f067873acd2f', 'serial': '4fa6f397-6fd1-4288-8d83-f067873acd2f'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'resources' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<64004f1c-2f3f-4d02-8632-823a13493b17> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'numa_topology' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<64004f1c-2f3f-4d02-8632-823a13493b17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:53:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'vcpu_model' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<64004f1c-2f3f-4d02-8632-823a13493b17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:09 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:09 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:09 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[442b0750-b033-4aaf-94c9-481201144d28]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lrFTqEYI\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 15 05:53:09 user nova-compute[75648]: node.name = iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:53:09 user nova-compute[75648]: node.tpgt = -1
Nov 15 05:53:09 user nova-compute[75648]: node.startup = automatic
Nov 15 05:53:09 user nova-compute[75648]: node.leading_login = No
Nov 15 05:53:09 user nova-compute[75648]: iface.iscsi_ifacename = default
Nov 15 05:53:09 user nova-compute[75648]: iface.net_ifacename = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.ipaddress = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.prefix_len = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.hwaddress = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.transport_name = tcp
Nov 15 05:53:09 user nova-compute[75648]: iface.initiatorname = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.vlan_id = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.vlan_priority = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.vlan_state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.iface_num = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.mtu = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.port = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.bootproto = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.subnet_mask = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.gateway = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_alt_client_id_state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_alt_client_id = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_dns = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_learn_iqn = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_req_vendor_id_state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_vendor_id_state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_vendor_id = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.dhcp_slp_da = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.fragmentation = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.gratuitous_arp = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.incoming_forwarding = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.tos_state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.tos = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.ttl = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.delayed_ack = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.tcp_nagle = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.tcp_wsf_state = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.tcp_wsf = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.tcp_timer_scale = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.tcp_timestamp = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.redirect = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.def_task_mgmt_timeout = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.header_digest = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.data_digest = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.immediate_data = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.initial_r2t = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.data_seq_inorder = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.data_pdu_inorder = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.erl = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.max_receive_data_len = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.first_burst_len = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.max_outstanding_r2t = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.max_burst_len = 0
Nov 15 05:53:09 user nova-compute[75648]: iface.chap_auth = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.bidi_chap = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.strict_login_compliance = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.discovery_auth = <empty>
Nov 15 05:53:09 user nova-compute[75648]: iface.discovery_logout = <empty>
Nov 15 05:53:09 user nova-compute[75648]: node.discovery_address = <empty>
Nov 15 05:53:09 user nova-compute[75648]: node.discovery_port = 0
Nov 15 05:53:09 user nova-compute[75648]: node.discovery_type = static
Nov 15 05:53:09 user nova-compute[75648]: node.session.initial_cmdsn = 0
Nov 15 05:53:09 user nova-compute[75648]: node.session.initial_login_retry_max = 8
Nov 15 05:53:09 user nova-compute[75648]: node.session.xmit_thread_priority = -20
Nov 15 05:53:09 user nova-compute[75648]: node.session.cmds_max = 128
Nov 15 05:53:09 user nova-compute[75648]: node.session.queue_depth = 32
Nov 15 05:53:09 user nova-compute[75648]: node.session.nr_sessions = 1
Nov 15 05:53:09 user nova-compute[75648]: node.session.auth.authmethod = CHAP
Nov 15 05:53:09 user nova-compute[75648]: node.session.auth.username = lrFTqEYI
Nov 15 05:53:09 user nova-compute[75648]: node.session.auth.password = ***
Nov 15 05:53:09 user nova-compute[75648]: node.session.auth.username_in = <empty>
Nov 15 05:53:09 user nova-compute[75648]: node.session.auth.password_in = <empty>
Nov 15 05:53:09 user nova-compute[75648]: node.session.auth.chap_algs = MD5
Nov 15 05:53:09 user nova-compute[75648]: node.session.timeo.replacement_timeout = 120
Nov 15 05:53:09 user nova-compute[75648]: node.session.err_timeo.abort_timeout = 15
Nov 15 05:53:09 user nova-compute[75648]: node.session.err_timeo.lu_reset_timeout = 30
Nov 15 05:53:09 user nova-compute[75648]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 15 05:53:09 user nova-compute[75648]: node.session.err_timeo.host_reset_timeout = 60
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.FastAbort = Yes
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.InitialR2T = No
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.ImmediateData = Yes
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.FirstBurstLength = 262144
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.MaxBurstLength = 16776192
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.DefaultTime2Retain = 0
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.DefaultTime2Wait = 2
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.MaxConnections = 1
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 15 05:53:09 user nova-compute[75648]: node.session.iscsi.ERL = 0
Nov 15 05:53:09 user nova-compute[75648]: node.session.scan = manual
Nov 15 05:53:09 user nova-compute[75648]: node.session.reopen_max = 0
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].address = 172.16.0.220
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].port = 3260
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].startup = manual
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].tcp.window_size = 524288
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].tcp.type_of_service = 0
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].timeo.logout_timeout = 15
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].timeo.login_timeout = 15
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].timeo.auth_timeout = 45
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].timeo.noop_out_interval = 5
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].timeo.noop_out_timeout = 5
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].iscsi.HeaderDigest = None
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].iscsi.DataDigest = None
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].iscsi.IFMarker = No
Nov 15 05:53:09 user nova-compute[75648]: node.conn[0].iscsi.OFMarker = No
Nov 15 05:53:09 user nova-compute[75648]: # END RECORD
Nov 15 05:53:09 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7128e3db-05da-4f67-a5d2-24324c381efc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e6f2e8-ffda-4374-ae76-f8aec78bffbd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrFTqEYI {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lrFTqEYI" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec35eea9-bdbd-421a-94eb-e95f6e60104d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lrFTqEYI'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8bf83-6a3e-4481-a50c-c2531b95c873]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3105d9d8-d7a2-427e-a9a3-e34ab6d41ebf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)
Nov 15 05:53:09 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:09 user nova-compute[75648]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)
Nov 15 05:53:09 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.154s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] HCTL ('37', '0', '0', 0) found on session 33 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9aba71-5d67-4c95-a6fe-e31b2759649e]: (4, ('0 0 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Searching for a device in session 33 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.178s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== connect_volume: return (179ms) {'type': 'block', 'scsi_wwn': '23466313736663634', 'path': '/dev/sdf'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466313736663634', 'path': '/dev/sdf'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1854119887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1854119887',id=36,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-4s3zb3l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:51:31Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=64004f1c-2f3f-4d02-8632-823a13493b17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "vif_mac": "fa:16:3e:e9:99:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "vif_mac": "fa:16:3e:e9:99:2a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'pci_devices' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Object Instance<64004f1c-2f3f-4d02-8632-823a13493b17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:53:09 user nova-compute[75648]:   <uuid>64004f1c-2f3f-4d02-8632-823a13493b17</uuid>
Nov 15 05:53:09 user nova-compute[75648]:   <name>instance-00000024</name>
Nov 15 05:53:09 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:53:09 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:53:09 user nova-compute[75648]:   <metadata>
Nov 15 05:53:09 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:53:09 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:53:09 user nova-compute[75648]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1854119887</nova:name>
Nov 15 05:53:09 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:53:09</nova:creationTime>
Nov 15 05:53:09 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:53:09 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:53:09 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:53:09 user nova-compute[75648]:       <nova:owner>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:user uuid="47b4817a59584433a28790c3a16d0b5c">tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member</nova:user>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:project uuid="c13f9a55b45f4f9992e2f86628b34982">tempest-ServerBootFromVolumeStableRescueTest-893883912</nova:project>
Nov 15 05:53:09 user nova-compute[75648]:       </nova:owner>
Nov 15 05:53:09 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:53:09 user nova-compute[75648]:       <nova:ports>
Nov 15 05:53:09 user nova-compute[75648]:         <nova:port uuid="a6ef8671-4b2e-4715-a58c-ebc9ea360446">
Nov 15 05:53:09 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 15 05:53:09 user nova-compute[75648]:         </nova:port>
Nov 15 05:53:09 user nova-compute[75648]:       </nova:ports>
Nov 15 05:53:09 user nova-compute[75648]:     </nova:instance>
Nov 15 05:53:09 user nova-compute[75648]:   </metadata>
Nov 15 05:53:09 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:53:09 user nova-compute[75648]:     <system>
Nov 15 05:53:09 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:53:09 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:53:09 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:53:09 user nova-compute[75648]:       <entry name="serial">64004f1c-2f3f-4d02-8632-823a13493b17</entry>
Nov 15 05:53:09 user nova-compute[75648]:       <entry name="uuid">64004f1c-2f3f-4d02-8632-823a13493b17</entry>
Nov 15 05:53:09 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:53:09 user nova-compute[75648]:     </system>
Nov 15 05:53:09 user nova-compute[75648]:   </sysinfo>
Nov 15 05:53:09 user nova-compute[75648]:   <os>
Nov 15 05:53:09 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:53:09 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:53:09 user nova-compute[75648]:   </os>
Nov 15 05:53:09 user nova-compute[75648]:   <features>
Nov 15 05:53:09 user nova-compute[75648]:     <acpi/>
Nov 15 05:53:09 user nova-compute[75648]:     <apic/>
Nov 15 05:53:09 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:53:09 user nova-compute[75648]:   </features>
Nov 15 05:53:09 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:53:09 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:53:09 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:53:09 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:53:09 user nova-compute[75648]:   </clock>
Nov 15 05:53:09 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:53:09 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:53:09 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:53:09 user nova-compute[75648]:   </cpu>
Nov 15 05:53:09 user nova-compute[75648]:   <devices>
Nov 15 05:53:09 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:53:09 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:53:09 user nova-compute[75648]:       <source dev="/dev/sdf"/>
Nov 15 05:53:09 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:53:09 user nova-compute[75648]:       <serial>4fa6f397-6fd1-4288-8d83-f067873acd2f</serial>
Nov 15 05:53:09 user nova-compute[75648]:     </disk>
Nov 15 05:53:09 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:53:09 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:53:09 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue"/>
Nov 15 05:53:09 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:53:09 user nova-compute[75648]:       <boot order="1"/>
Nov 15 05:53:09 user nova-compute[75648]:     </disk>
Nov 15 05:53:09 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:53:09 user nova-compute[75648]:       <mac address="fa:16:3e:e9:99:2a"/>
Nov 15 05:53:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:53:09 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:53:09 user nova-compute[75648]:       <target dev="tapa6ef8671-4b"/>
Nov 15 05:53:09 user nova-compute[75648]:     </interface>
Nov 15 05:53:09 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:53:09 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/console.log" append="off"/>
Nov 15 05:53:09 user nova-compute[75648]:     </serial>
Nov 15 05:53:09 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:53:09 user nova-compute[75648]:     <video>
Nov 15 05:53:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:53:09 user nova-compute[75648]:     </video>
Nov 15 05:53:09 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:53:09 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:53:09 user nova-compute[75648]:     </rng>
Nov 15 05:53:09 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:53:09 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:53:09 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:53:09 user nova-compute[75648]:     </memballoon>
Nov 15 05:53:09 user nova-compute[75648]:   </devices>
Nov 15 05:53:09 user nova-compute[75648]: </domain>
Nov 15 05:53:09 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:53:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance destroyed successfully.
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:53:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] No VIF found with MAC fa:16:3e:e9:99:2a, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-682d0ab1-e640-4a5e-852a-d5922cb93b58 req-e2d815c3-2b7b-4788-8cf0-fa7d73fc0742 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-682d0ab1-e640-4a5e-852a-d5922cb93b58 req-e2d815c3-2b7b-4788-8cf0-fa7d73fc0742 service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-682d0ab1-e640-4a5e-852a-d5922cb93b58 req-e2d815c3-2b7b-4788-8cf0-fa7d73fc0742 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-682d0ab1-e640-4a5e-852a-d5922cb93b58 req-e2d815c3-2b7b-4788-8cf0-fa7d73fc0742 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-682d0ab1-e640-4a5e-852a-d5922cb93b58 req-e2d815c3-2b7b-4788-8cf0-fa7d73fc0742 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:11 user nova-compute[75648]: WARNING nova.compute.manager [req-682d0ab1-e640-4a5e-852a-d5922cb93b58 req-e2d815c3-2b7b-4788-8cf0-fa7d73fc0742 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state active and task_state rescuing.
Nov 15 05:53:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-d59b4292-0bf1-492c-93d8-1fa610aee879 req-adf83f0a-4842-4e33-9023-f899c5b5abe8 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d59b4292-0bf1-492c-93d8-1fa610aee879 req-adf83f0a-4842-4e33-9023-f899c5b5abe8 service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d59b4292-0bf1-492c-93d8-1fa610aee879 req-adf83f0a-4842-4e33-9023-f899c5b5abe8 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d59b4292-0bf1-492c-93d8-1fa610aee879 req-adf83f0a-4842-4e33-9023-f899c5b5abe8 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-d59b4292-0bf1-492c-93d8-1fa610aee879 req-adf83f0a-4842-4e33-9023-f899c5b5abe8 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:13 user nova-compute[75648]: WARNING nova.compute.manager [req-d59b4292-0bf1-492c-93d8-1fa610aee879 req-adf83f0a-4842-4e33-9023-f899c5b5abe8 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state active and task_state rescuing.
Nov 15 05:53:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-af9dc418-1cd4-4e3f-914b-47b061e7107b tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:53:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5b473790-b699-419b-81be-b36b42f6ba5a is timed out.
Nov 15 05:53:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully detached device vdb from instance 5b473790-b699-419b-81be-b36b42f6ba5a from the live domain config.
Nov 15 05:53:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHtIZBxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:18 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1175fb-00f3-4b3c-8329-d3f2b6b68251]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:53:18 user nova-compute[75648]: No targets found.
Nov 15 05:53:18 user nova-compute[75648]: iSNS:
Nov 15 05:53:18 user nova-compute[75648]: No targets found.
Nov 15 05:53:18 user nova-compute[75648]: STATIC:
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:53:18 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:18 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:18 user nova-compute[75648]: FIRMWARE:
Nov 15 05:53:18 user nova-compute[75648]: No targets found.
Nov 15 05:53:18 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:53:18 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:53:18 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[26960890-2a03-4081-ac27-1e394bb28d0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[186f4ec9-bde2-43e9-ac63-9dcc8e5ef09a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)
Nov 15 05:53:18 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:18 user nova-compute[75648]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd (non-flash)
Nov 15 05:53:18 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8589c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd'): ({'sdh'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Removing single pathed devices sdh {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d6dad7-af7a-4c62-9fa9-538b7100af39]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcb7121-6fd6-4147-a247-0253fb070ecb]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Flushing IO for device /dev/sdh {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[771ef183-c1b1-4eb8-bb01-308bc95c262b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d594f59a-3dc1-4627-beac-9261c7a772be]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] SCSI volumes sdh have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae56413-db04-4102-b232-6e417141b67f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b824f7-1d16-4f27-a71b-4d2dce32d5b7]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260]
Nov 15 05:53:18 user nova-compute[75648]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd, portal: 172.16.0.220,3260] successful.
Nov 15 05:53:18 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b114007f-8e60-4ea2-8f98-1cd420f245fd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== disconnect_volume: return (344ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG nova.objects.instance [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'flavor' on Instance uuid 5b473790-b699-419b-81be-b36b42f6ba5a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-aee15508-b0fe-418c-b334-c032b7ef62d1 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.735s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.614s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:19 user nova-compute[75648]: INFO nova.compute.manager [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Terminating instance
Nov 15 05:53:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-464b1709-0e64-4748-a14b-f014bc2774eb req-2a5a3a22-a150-4960-965a-177a35b260f7 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-vif-unplugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-464b1709-0e64-4748-a14b-f014bc2774eb req-2a5a3a22-a150-4960-965a-177a35b260f7 service nova] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-464b1709-0e64-4748-a14b-f014bc2774eb req-2a5a3a22-a150-4960-965a-177a35b260f7 service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-464b1709-0e64-4748-a14b-f014bc2774eb req-2a5a3a22-a150-4960-965a-177a35b260f7 service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-464b1709-0e64-4748-a14b-f014bc2774eb req-2a5a3a22-a150-4960-965a-177a35b260f7 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] No waiting events found dispatching network-vif-unplugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-464b1709-0e64-4748-a14b-f014bc2774eb req-2a5a3a22-a150-4960-965a-177a35b260f7 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-vif-unplugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:53:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Instance destroyed successfully.
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.objects.instance [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lazy-loading 'resources' on Instance uuid 5b473790-b699-419b-81be-b36b42f6ba5a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:50:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-526733281',display_name='tempest-VolumesSnapshotTestJSON-instance-526733281',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-526733281',id=35,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkmvn+FRVYhRw8MnvKRt+iCOspCOe0q2h6cl7pHLjTc51ZPrAAQopLzKDOYCNLM8DcPQogEjrWCABge8WHwQN/STtuwbui/tJyhvhDuC2O0gsLsCQb5SwnnmxGrgCDcCw==',key_name='tempest-keypair-355185450',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:50:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f018e72ae1144091adb4ae568a3926a0',ramdisk_id='',reservation_id='r-nqt0zuj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1092113651',owner_user_name='tempest-VolumesSnapshotTestJSON-1092113651-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2b746581c3514859949345b4a3c3b03c',uuid=5b473790-b699-419b-81be-b36b42f6ba5a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converting VIF {"id": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "address": "fa:16:3e:ca:a2:22", "network": {"id": "773b911c-2631-4680-8831-3b37c4381178", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1263376069-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f018e72ae1144091adb4ae568a3926a0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf7e15dd8-b3", "ovs_interfaceid": "f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_vif [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf7e15dd8-b3, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e76a3f44-eb4e-4302-9ece-ad0eedc97422) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:20 user nova-compute[75648]: INFO os_vif [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ca:a2:22,bridge_name='br-int',has_traffic_filtering=True,id=f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607,network=Network(773b911c-2631-4680-8831-3b37c4381178),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf7e15dd8-b3')
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHtIZBxE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:20 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245e66b-21e8-47c8-b43e-687f9f10576a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:53:20 user nova-compute[75648]: No targets found.
Nov 15 05:53:20 user nova-compute[75648]: iSNS:
Nov 15 05:53:20 user nova-compute[75648]: No targets found.
Nov 15 05:53:20 user nova-compute[75648]: STATIC:
Nov 15 05:53:20 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:53:20 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:20 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:20 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64
Nov 15 05:53:20 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:20 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:20 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:53:20 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:20 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:20 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:53:20 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:20 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:20 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:53:20 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:20 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:20 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:53:20 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:20 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:20 user nova-compute[75648]: FIRMWARE:
Nov 15 05:53:20 user nova-compute[75648]: No targets found.
Nov 15 05:53:20 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:53:20 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:53:20 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:65c10648-dcf8-43e5-80bd-d53730c094bd', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec37bd4-80b1-4495-8fc3-2227795dc905]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.081s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[68044481-068d-4b38-bdd1-e1bbaa69f366]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:20 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:20 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:20 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9f14137f0>, {}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Disconnecting from: [] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.135s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] <== disconnect_volume: return (137ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:53:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Deleting instance files /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a_del
Nov 15 05:53:20 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Deletion of /opt/stack/data/nova/instances/5b473790-b699-419b-81be-b36b42f6ba5a_del complete
Nov 15 05:53:20 user nova-compute[75648]: INFO nova.compute.manager [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Took 1.13 seconds to destroy the instance on the hypervisor.
Nov 15 05:53:20 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:53:20 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing instance network info cache due to event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updated VIF entry in instance network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG nova.network.neutron [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c3df0970-f20b-45b6-a0a4-0e3211db142c req-8086aa39-83ae-452d-bbd4-81d91f674bd7 service nova] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:21 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Took 0.87 seconds to deallocate network for instance.
Nov 15 05:53:21 user nova-compute[75648]: WARNING nova.volume.cinder [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Attachment 35328ccf-6101-40e1-8c78-1ecf5459ccae does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 35328ccf-6101-40e1-8c78-1ecf5459ccae. (HTTP 404) (Request-ID: req-c4cce4c6-befc-4973-9a89-6715117832fa)
Nov 15 05:53:21 user nova-compute[75648]: INFO nova.compute.manager [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Took 0.03 seconds to detach 1 volumes for instance.
Nov 15 05:53:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] Acquiring lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] Lock "5b473790-b699-419b-81be-b36b42f6ba5a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] No waiting events found dispatching network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:22 user nova-compute[75648]: WARNING nova.compute.manager [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received unexpected event network-vif-plugged-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 for instance with vm_state deleted and task_state None.
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing instance network info cache due to event network-changed-61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] Acquiring lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] Acquired lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Refreshing network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:22 user nova-compute[75648]: INFO nova.compute.manager [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Detaching volume b8b88110-91d8-45cd-bf88-7f0d968f4d64
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.538s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:22 user nova-compute[75648]: INFO nova.virt.block_device [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Attempting to driver detach volume b8b88110-91d8-45cd-bf88-7f0d968f4d64 from mountpoint /dev/vdb
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Attempting to detach device vdb from instance 878ae6df-048e-4181-895e-64ad390935dc from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:53:22 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:53:22 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:53:22 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:53:22 user nova-compute[75648]:   <serial>b8b88110-91d8-45cd-bf88-7f0d968f4d64</serial>
Nov 15 05:53:22 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:53:22 user nova-compute[75648]: </disk>
Nov 15 05:53:22 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:53:22 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully detached device vdb from instance 878ae6df-048e-4181-895e-64ad390935dc from the persistent domain config.
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 878ae6df-048e-4181-895e-64ad390935dc from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:53:22 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:53:22 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:53:22 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:53:22 user nova-compute[75648]:   <serial>b8b88110-91d8-45cd-bf88-7f0d968f4d64</serial>
Nov 15 05:53:22 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:53:22 user nova-compute[75648]: </disk>
Nov 15 05:53:22 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:53:22 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Deleted allocations for instance 5b473790-b699-419b-81be-b36b42f6ba5a
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-687068b4-40f2-4265-9ba7-c9bf90a70050 tempest-VolumesSnapshotTestJSON-1092113651 tempest-VolumesSnapshotTestJSON-1092113651-project-member] Lock "5b473790-b699-419b-81be-b36b42f6ba5a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.786s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updated VIF entry in instance network info cache for port 61cc90ce-a6c4-41b5-869b-222e051f6c36. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [{"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d58ae2ea-b352-448c-bf65-1dd92dfb1a5c req-0fd03adc-cd25-423f-b96b-ce6c0c7cf812 service nova] Releasing lock "refresh_cache-878ae6df-048e-4181-895e-64ad390935dc" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 878ae6df-048e-4181-895e-64ad390935dc {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:53:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-b1533911-9a1d-4cf9-8daa-14c643896f8c req-50c97327-5224-4909-b6db-4d85bd8a7d8f service nova] [instance: 5b473790-b699-419b-81be-b36b42f6ba5a] Received event network-vif-deleted-f7e15dd8-b3ca-4b6e-8a4a-34613d9d6607 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:26 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 is timed out.
Nov 15 05:53:26 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully detached device vdb from instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 from the live domain config.
Nov 15 05:53:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHgQGsMU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:26 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce315f2b-4d6b-4541-8b88-7b1ce8f8dcf2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:53:26 user nova-compute[75648]: No targets found.
Nov 15 05:53:26 user nova-compute[75648]: iSNS:
Nov 15 05:53:26 user nova-compute[75648]: No targets found.
Nov 15 05:53:26 user nova-compute[75648]: STATIC:
Nov 15 05:53:26 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596
Nov 15 05:53:26 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:26 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:26 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64
Nov 15 05:53:26 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:26 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:26 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:53:26 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:26 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:26 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:53:26 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:26 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:26 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:53:26 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:26 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:26 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:53:26 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:26 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:26 user nova-compute[75648]: FIRMWARE:
Nov 15 05:53:26 user nova-compute[75648]: No targets found.
Nov 15 05:53:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:53:26 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:53:26 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a3e936-6374-47e8-a119-0825c7659ee1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d95aea-37a9-4450-9c13-6e6b5cd1eaeb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:26 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47acb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[54447709-edc1-4324-8ff3-c16a1aa6e437]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe56123-4a83-4544-aede-9f726e449370]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae222ed-417a-44dc-afc8-4c9040257ce8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[033f511d-1ff4-4f1b-a8c0-57e1236ea9e1]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9b7ad7-9679-44ae-83aa-e3b349c1ea02]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dcaa7b9-f559-4d86-af2a-3f8a3ae7b232]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260]
Nov 15 05:53:26 user nova-compute[75648]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596, portal: 172.16.0.220,3260] successful.
Nov 15 05:53:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ac36aea3-30c2-4cd1-a805-cc07d1c5e596 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd041e5-6132-467d-b088-edb68947d7b9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] <== disconnect_volume: return (399ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:53:27 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'flavor' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d209411f-1a9e-4069-bd98-a09ecb65130c tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-changed-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Refreshing instance network info cache due to event network-changed-83f94d30-6074-487a-a9b2-8bf156cfdc70. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] Acquiring lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] Acquired lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:36 user nova-compute[75648]: DEBUG nova.network.neutron [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Refreshing network info cache for port 83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updated VIF entry in instance network info cache for port 83f94d30-6074-487a-a9b2-8bf156cfdc70. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updating instance_info_cache with network_info: [{"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d6c7cb44-0d35-4b6f-a899-c2976e30f3f8 req-3a8f9da7-d86d-483b-9371-b6daed6cc886 service nova] Releasing lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "84676ebd-9adb-45fb-8efb-55079478860b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:40 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:53:40 user nova-compute[75648]: INFO nova.compute.claims [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Claim successful on node user
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:53:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.policy [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fd4a8513df14fc7ab09905d24220ae1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bea832b577b9445782f27e28b1023e96', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:53:41 user nova-compute[75648]: INFO nova.virt.block_device [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Booting with volume bf20c0a8-4092-4fa6-a167-1d90eaa07a4e at /dev/vda
Nov 15 05:53:41 user nova-compute[75648]: DEBUG os_brick.utils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e29ba6-8cc9-47bc-872a-36c37c52a5a7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c9cd94-9a48-4023-8c65-8c6df59e0c50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ab922-df68-45c7-9a6d-68a07579a0b7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15c8798-fcc5-405d-8977-0e11554d9359]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:53:41 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:53:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae99251-7163-444f-8c52-0ce9fe57c489]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG os_brick.utils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:41 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updating existing volume attachment record: 4bc7d7b8-2076-49ff-a5f7-a36a33470794 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Successfully created port: 54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:53:42 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 878ae6df-048e-4181-895e-64ad390935dc is timed out.
Nov 15 05:53:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully detached device vdb from instance 878ae6df-048e-4181-895e-64ad390935dc from the live domain config.
Nov 15 05:53:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ErTeAYXB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:42 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e10f36-4bcd-49d0-9612-120542bd2233]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:53:42 user nova-compute[75648]: No targets found.
Nov 15 05:53:42 user nova-compute[75648]: iSNS:
Nov 15 05:53:42 user nova-compute[75648]: No targets found.
Nov 15 05:53:42 user nova-compute[75648]: STATIC:
Nov 15 05:53:42 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64
Nov 15 05:53:42 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:42 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:42 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:53:42 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:42 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:42 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:53:42 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:42 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:42 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:53:42 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:42 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:42 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:53:42 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:53:42 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:53:42 user nova-compute[75648]: FIRMWARE:
Nov 15 05:53:42 user nova-compute[75648]: No targets found.
Nov 15 05:53:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:53:42 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:53:42 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8e96d2-be53-49c5-9923-57e2476dceb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e0d55f-7e87-45be-9455-aa38b10c81ee]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:42 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e858a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:53:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[97833d80-5fde-471a-b002-3ccd6afeea53]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1e4493-a8fd-4c55-be65-4d328fd73013]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Successfully updated port: 54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f813d6e2-ccc7-4c81-b3eb-98a0c488bb19]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquired lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-changed-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Refreshing instance network info cache due to event network-changed-54c2ffb3-5d68-4609-9627-2a39d6013261. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] Acquiring lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac338d-ee0b-4c91-913a-5f3c719bec2d]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[466b5696-9d8f-4ade-b7c8-b1553c92146c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a281d3b-b4de-4edf-8c11-71270ecc9bb2]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260]
Nov 15 05:53:43 user nova-compute[75648]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64, portal: 172.16.0.220,3260] successful.
Nov 15 05:53:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8b88110-91d8-45cd-bf88-7f0d968f4d64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[94adb498-b180-4063-a0b2-ca5417c8b4dc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] <== disconnect_volume: return (338ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updating instance_info_cache with network_info: [{"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Releasing lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Instance network_info: |[{"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] Acquired lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Refreshing network info cache for port 54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updated VIF entry in instance network info cache for port 54c2ffb3-5d68-4609-9627-2a39d6013261. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updating instance_info_cache with network_info: [{"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2505c99f-7d6d-44e7-8edc-779fc68f0dac req-af965345-2e69-4eec-87aa-ad3227ca754e service nova] Releasing lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:53:44 user nova-compute[75648]: DEBUG nova.objects.instance [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'flavor' on Instance uuid 878ae6df-048e-4181-895e-64ad390935dc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-af071494-1d5d-4fa6-a64c-8b2c3fe22b0b tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.874s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:53:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Creating image(s)
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Ensure instance console log exists: /opt/stack/data/nova/instances/84676ebd-9adb-45fb-8efb-55079478860b/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Start _get_guest_xml network_info=[{"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '4bc7d7b8-2076-49ff-a5f7-a36a33470794', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIuJFhdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '84676ebd-9adb-45fb-8efb-55079478860b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf20c0a8-4092-4fa6-a167-1d90eaa07a4e', 'serial': 'bf20c0a8-4092-4fa6-a167-1d90eaa07a4e'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:53:47 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:47 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIuJFhdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:53:47 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:47 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:53:47 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0631e11e-cd74-4d6e-8587-d44c79dd943a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:53:47 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2582f55-3dcf-48b3-9530-14a991a46255]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e] added
Nov 15 05:53:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[72425349-4c09-48ec-bbc9-4a29de76440b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65aecfe-ed12-44f6-a774-8b4dff7c5f0b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIuJFhdp {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aIuJFhdp" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[82eb7ff7-fb50-4f43-85d9-bf6610200e0d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aIuJFhdp'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c912ca4f-a370-4b20-841b-c346f004b93b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88564afc-a4a8-476c-a657-bf2778f9faf7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a940d5-6de3-4bb5-b3e6-f09cfc97379e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260]
Nov 15 05:53:47 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260] successful.
Nov 15 05:53:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c31e1b-c5d9-436b-a4c5-56354549c313]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d311709-95f2-411c-9d4a-f19639970a54]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:53:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:53:47 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:53:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[130ccacc-ad66-434d-9095-c3faea008d52]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:53:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIuJFhdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23839383833646461', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839383833646461', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-734886916',display_name='tempest-TestVolumeBootPattern-server-734886916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-734886916',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-iqi5hqhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:53:42Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=84676ebd-9adb-45fb-8efb-55079478860b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'pci_devices' on Instance uuid 84676ebd-9adb-45fb-8efb-55079478860b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:53:48 user nova-compute[75648]:   <uuid>84676ebd-9adb-45fb-8efb-55079478860b</uuid>
Nov 15 05:53:48 user nova-compute[75648]:   <name>instance-00000028</name>
Nov 15 05:53:48 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:53:48 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:53:48 user nova-compute[75648]:   <metadata>
Nov 15 05:53:48 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:53:48 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:53:48 user nova-compute[75648]:       <nova:name>tempest-TestVolumeBootPattern-server-734886916</nova:name>
Nov 15 05:53:48 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:53:47</nova:creationTime>
Nov 15 05:53:48 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:53:48 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:53:48 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:53:48 user nova-compute[75648]:       <nova:owner>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:user uuid="2fd4a8513df14fc7ab09905d24220ae1">tempest-TestVolumeBootPattern-522670763-project-member</nova:user>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:project uuid="bea832b577b9445782f27e28b1023e96">tempest-TestVolumeBootPattern-522670763</nova:project>
Nov 15 05:53:48 user nova-compute[75648]:       </nova:owner>
Nov 15 05:53:48 user nova-compute[75648]:       <nova:ports>
Nov 15 05:53:48 user nova-compute[75648]:         <nova:port uuid="54c2ffb3-5d68-4609-9627-2a39d6013261">
Nov 15 05:53:48 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:53:48 user nova-compute[75648]:         </nova:port>
Nov 15 05:53:48 user nova-compute[75648]:       </nova:ports>
Nov 15 05:53:48 user nova-compute[75648]:     </nova:instance>
Nov 15 05:53:48 user nova-compute[75648]:   </metadata>
Nov 15 05:53:48 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:53:48 user nova-compute[75648]:     <system>
Nov 15 05:53:48 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:53:48 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:53:48 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:53:48 user nova-compute[75648]:       <entry name="serial">84676ebd-9adb-45fb-8efb-55079478860b</entry>
Nov 15 05:53:48 user nova-compute[75648]:       <entry name="uuid">84676ebd-9adb-45fb-8efb-55079478860b</entry>
Nov 15 05:53:48 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:53:48 user nova-compute[75648]:     </system>
Nov 15 05:53:48 user nova-compute[75648]:   </sysinfo>
Nov 15 05:53:48 user nova-compute[75648]:   <os>
Nov 15 05:53:48 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:53:48 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:53:48 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:53:48 user nova-compute[75648]:   </os>
Nov 15 05:53:48 user nova-compute[75648]:   <features>
Nov 15 05:53:48 user nova-compute[75648]:     <acpi/>
Nov 15 05:53:48 user nova-compute[75648]:     <apic/>
Nov 15 05:53:48 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:53:48 user nova-compute[75648]:   </features>
Nov 15 05:53:48 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:53:48 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:53:48 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:53:48 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:53:48 user nova-compute[75648]:   </clock>
Nov 15 05:53:48 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:53:48 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:53:48 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:53:48 user nova-compute[75648]:   </cpu>
Nov 15 05:53:48 user nova-compute[75648]:   <devices>
Nov 15 05:53:48 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:53:48 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:53:48 user nova-compute[75648]:       <source dev="/dev/sdc"/>
Nov 15 05:53:48 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:53:48 user nova-compute[75648]:       <serial>bf20c0a8-4092-4fa6-a167-1d90eaa07a4e</serial>
Nov 15 05:53:48 user nova-compute[75648]:     </disk>
Nov 15 05:53:48 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:53:48 user nova-compute[75648]:       <mac address="fa:16:3e:fe:88:f1"/>
Nov 15 05:53:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:53:48 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:53:48 user nova-compute[75648]:       <target dev="tap54c2ffb3-5d"/>
Nov 15 05:53:48 user nova-compute[75648]:     </interface>
Nov 15 05:53:48 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:53:48 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/84676ebd-9adb-45fb-8efb-55079478860b/console.log" append="off"/>
Nov 15 05:53:48 user nova-compute[75648]:     </serial>
Nov 15 05:53:48 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:53:48 user nova-compute[75648]:     <video>
Nov 15 05:53:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:53:48 user nova-compute[75648]:     </video>
Nov 15 05:53:48 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:53:48 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:53:48 user nova-compute[75648]:     </rng>
Nov 15 05:53:48 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:53:48 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:53:48 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:53:48 user nova-compute[75648]:     </memballoon>
Nov 15 05:53:48 user nova-compute[75648]:   </devices>
Nov 15 05:53:48 user nova-compute[75648]: </domain>
Nov 15 05:53:48 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-734886916',display_name='tempest-TestVolumeBootPattern-server-734886916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-734886916',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-iqi5hqhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:53:42Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=84676ebd-9adb-45fb-8efb-55079478860b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG os_vif [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3470c9e3-cea8-523e-b25f-588647e59d13', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54c2ffb3-5d, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54c2ffb3-5d, col_values=(('qos', UUID('bda833e0-9b18-40ac-8ef5-4f0911790ea6')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54c2ffb3-5d, col_values=(('external_ids', {'iface-id': '54c2ffb3-5d68-4609-9627-2a39d6013261', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:88:f1', 'vm-uuid': '84676ebd-9adb-45fb-8efb-55079478860b'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:48 user nova-compute[75648]: INFO os_vif [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d')
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:53:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] No VIF found with MAC fa:16:3e:fe:88:f1, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-8759aefc-3ecf-4c4d-8d1b-3c52b5da4fd2 req-acb91949-af64-4064-b059-9a9a7a506a21 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8759aefc-3ecf-4c4d-8d1b-3c52b5da4fd2 req-acb91949-af64-4064-b059-9a9a7a506a21 service nova] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8759aefc-3ecf-4c4d-8d1b-3c52b5da4fd2 req-acb91949-af64-4064-b059-9a9a7a506a21 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8759aefc-3ecf-4c4d-8d1b-3c52b5da4fd2 req-acb91949-af64-4064-b059-9a9a7a506a21 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-8759aefc-3ecf-4c4d-8d1b-3c52b5da4fd2 req-acb91949-af64-4064-b059-9a9a7a506a21 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] No waiting events found dispatching network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:50 user nova-compute[75648]: WARNING nova.compute.manager [req-8759aefc-3ecf-4c4d-8d1b-3c52b5da4fd2 req-acb91949-af64-4064-b059-9a9a7a506a21 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received unexpected event network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 for instance with vm_state building and task_state spawning.
Nov 15 05:53:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:53:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Instance spawned successfully.
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-bddbf9fa-3e66-4389-a51e-75dfa5586c3e req-492aa8fd-bdac-405a-9f39-a4d5e5751491 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bddbf9fa-3e66-4389-a51e-75dfa5586c3e req-492aa8fd-bdac-405a-9f39-a4d5e5751491 service nova] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bddbf9fa-3e66-4389-a51e-75dfa5586c3e req-492aa8fd-bdac-405a-9f39-a4d5e5751491 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bddbf9fa-3e66-4389-a51e-75dfa5586c3e req-492aa8fd-bdac-405a-9f39-a4d5e5751491 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-bddbf9fa-3e66-4389-a51e-75dfa5586c3e req-492aa8fd-bdac-405a-9f39-a4d5e5751491 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] No waiting events found dispatching network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:52 user nova-compute[75648]: WARNING nova.compute.manager [req-bddbf9fa-3e66-4389-a51e-75dfa5586c3e req-492aa8fd-bdac-405a-9f39-a4d5e5751491 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received unexpected event network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 for instance with vm_state building and task_state spawning.
Nov 15 05:53:52 user nova-compute[75648]: INFO nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 15 05:53:52 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:53:52 user nova-compute[75648]: INFO nova.compute.manager [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Took 11.68 seconds to build instance.
Nov 15 05:53:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f3735c54-8abc-4c84-987f-80f853d35450 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "84676ebd-9adb-45fb-8efb-55079478860b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.792s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:55 user nova-compute[75648]: INFO nova.compute.manager [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Terminating instance
Nov 15 05:53:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae9ea946-2210-4561-8013-5d138580100f req-f63fcb51-4a75-4bfd-8791-d36c2c48565c service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae9ea946-2210-4561-8013-5d138580100f req-f63fcb51-4a75-4bfd-8791-d36c2c48565c service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae9ea946-2210-4561-8013-5d138580100f req-f63fcb51-4a75-4bfd-8791-d36c2c48565c service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae9ea946-2210-4561-8013-5d138580100f req-f63fcb51-4a75-4bfd-8791-d36c2c48565c service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae9ea946-2210-4561-8013-5d138580100f req-f63fcb51-4a75-4bfd-8791-d36c2c48565c service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae9ea946-2210-4561-8013-5d138580100f req-f63fcb51-4a75-4bfd-8791-d36c2c48565c service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-unplugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Instance destroyed successfully.
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.objects.instance [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'resources' on Instance uuid 2fe5ece1-e20e-432d-9af8-976dc679dea5 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-730897005',display_name='tempest-ServerRescueNegativeTestJSON-server-730897005',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-730897005',id=29,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeNhKhjh86kt/gllTgX5pbI5QJTkapa+6W4wRQBQBUTTAwINIqglvygMmhbfqi6rGshznaBKU0r6XfR6gP05drx93phOsW24NEkoygCvnORjJoCAQ6Xsu7TVKnNRlrq1Q==',key_name='tempest-keypair-1093223766',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:49:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-tis05mag',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:51:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=2fe5ece1-e20e-432d-9af8-976dc679dea5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "3a03d778-0782-478e-b330-30ad6415e732", "address": "fa:16:3e:39:80:ca", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3a03d778-07", "ovs_interfaceid": "3a03d778-0782-478e-b330-30ad6415e732", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG os_vif [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3a03d778-07, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be160440-f67e-4c86-829d-e9ece7c80834) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:56 user nova-compute[75648]: INFO os_vif [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:80:ca,bridge_name='br-int',has_traffic_filtering=True,id=3a03d778-0782-478e-b330-30ad6415e732,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3a03d778-07')
Nov 15 05:53:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Deleting instance files /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5_del
Nov 15 05:53:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Deletion of /opt/stack/data/nova/instances/2fe5ece1-e20e-432d-9af8-976dc679dea5_del complete
Nov 15 05:53:56 user nova-compute[75648]: INFO nova.compute.manager [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 15 05:53:56 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:53:56 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:53:57 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:57 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Took 0.91 seconds to deallocate network for instance.
Nov 15 05:53:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-4d43cb54-6ca8-46fe-b2de-8b97adfafc97 req-247bd370-287c-4f92-98bf-aa989ff4d1a6 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-deleted-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:57 user nova-compute[75648]: INFO nova.compute.manager [req-4d43cb54-6ca8-46fe-b2de-8b97adfafc97 req-247bd370-287c-4f92-98bf-aa989ff4d1a6 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Neutron deleted interface 3a03d778-0782-478e-b330-30ad6415e732; detaching it from the instance and deleting it from the info cache
Nov 15 05:53:57 user nova-compute[75648]: DEBUG nova.network.neutron [req-4d43cb54-6ca8-46fe-b2de-8b97adfafc97 req-247bd370-287c-4f92-98bf-aa989ff4d1a6 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:53:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-4d43cb54-6ca8-46fe-b2de-8b97adfafc97 req-247bd370-287c-4f92-98bf-aa989ff4d1a6 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Detach interface failed, port_id=3a03d778-0782-478e-b330-30ad6415e732, reason: Instance 2fe5ece1-e20e-432d-9af8-976dc679dea5 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:53:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-46e84384-cc0c-4c10-9eae-a5dc2fbed0f2 req-2018bd30-a00b-46c5-aa8c-92d36c8a3b57 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-46e84384-cc0c-4c10-9eae-a5dc2fbed0f2 req-2018bd30-a00b-46c5-aa8c-92d36c8a3b57 service nova] Acquiring lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-46e84384-cc0c-4c10-9eae-a5dc2fbed0f2 req-2018bd30-a00b-46c5-aa8c-92d36c8a3b57 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-46e84384-cc0c-4c10-9eae-a5dc2fbed0f2 req-2018bd30-a00b-46c5-aa8c-92d36c8a3b57 service nova] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-46e84384-cc0c-4c10-9eae-a5dc2fbed0f2 req-2018bd30-a00b-46c5-aa8c-92d36c8a3b57 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] No waiting events found dispatching network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:53:58 user nova-compute[75648]: WARNING nova.compute.manager [req-46e84384-cc0c-4c10-9eae-a5dc2fbed0f2 req-2018bd30-a00b-46c5-aa8c-92d36c8a3b57 service nova] [instance: 2fe5ece1-e20e-432d-9af8-976dc679dea5] Received unexpected event network-vif-plugged-3a03d778-0782-478e-b330-30ad6415e732 for instance with vm_state deleted and task_state None.
Nov 15 05:53:58 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Deleted allocations for instance 2fe5ece1-e20e-432d-9af8-976dc679dea5
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0446f759-ed8d-4555-b41b-56e4ddb0c6b2 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "2fe5ece1-e20e-432d-9af8-976dc679dea5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.445s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:59 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:53:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:53:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:53:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:53:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:54:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [{"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:54:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:54:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:54:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:05 user nova-compute[75648]: INFO nova.compute.manager [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Terminating instance
Nov 15 05:54:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-e095447a-976a-481f-9c46-cc69b136d565 req-3d80645d-ed37-4f19-9863-f2145d857197 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-vif-unplugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e095447a-976a-481f-9c46-cc69b136d565 req-3d80645d-ed37-4f19-9863-f2145d857197 service nova] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e095447a-976a-481f-9c46-cc69b136d565 req-3d80645d-ed37-4f19-9863-f2145d857197 service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e095447a-976a-481f-9c46-cc69b136d565 req-3d80645d-ed37-4f19-9863-f2145d857197 service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-e095447a-976a-481f-9c46-cc69b136d565 req-3d80645d-ed37-4f19-9863-f2145d857197 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] No waiting events found dispatching network-vif-unplugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-e095447a-976a-481f-9c46-cc69b136d565 req-3d80645d-ed37-4f19-9863-f2145d857197 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-vif-unplugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Instance destroyed successfully.
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.objects.instance [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lazy-loading 'resources' on Instance uuid 0aea1f03-161c-4b04-bee9-e0453ac6a110 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:45:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1676507330',display_name='tempest-ServersNegativeTestJSON-server-1676507330',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1676507330',id=24,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:45:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='27934c845b394f498de55243765a8f51',ramdisk_id='',reservation_id='r-5fcc29d6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1712721745',owner_user_name='tempest-ServersNegativeTestJSON-1712721745-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:31Z,user_data=None,user_id='143f1f9cdbe649ad9827f6b2ea96caeb',uuid=0aea1f03-161c-4b04-bee9-e0453ac6a110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converting VIF {"id": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "address": "fa:16:3e:d8:79:20", "network": {"id": "9025a043-ccbc-44c0-93f0-d98a911a1bba", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-553188739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "27934c845b394f498de55243765a8f51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapce1f1809-0c", "ovs_interfaceid": "ce1f1809-0c98-4469-a733-6bf3ccd594e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG os_vif [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapce1f1809-0c, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d92e9f2c-a34b-4839-8857-a92a9a4ab3f5) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:06 user nova-compute[75648]: INFO os_vif [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:79:20,bridge_name='br-int',has_traffic_filtering=True,id=ce1f1809-0c98-4469-a733-6bf3ccd594e3,network=Network(9025a043-ccbc-44c0-93f0-d98a911a1bba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapce1f1809-0c')
Nov 15 05:54:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Deleting instance files /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110_del
Nov 15 05:54:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Deletion of /opt/stack/data/nova/instances/0aea1f03-161c-4b04-bee9-e0453ac6a110_del complete
Nov 15 05:54:06 user nova-compute[75648]: INFO nova.compute.manager [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Took 0.76 seconds to destroy the instance on the hypervisor.
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-096bd2bc-dc7a-4332-abc1-95ae47409036 req-d148d8b9-6474-48a7-b65e-fbe9ec859954 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-vif-deleted-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:06 user nova-compute[75648]: INFO nova.compute.manager [req-096bd2bc-dc7a-4332-abc1-95ae47409036 req-d148d8b9-6474-48a7-b65e-fbe9ec859954 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Neutron deleted interface ce1f1809-0c98-4469-a733-6bf3ccd594e3; detaching it from the instance and deleting it from the info cache
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.network.neutron [req-096bd2bc-dc7a-4332-abc1-95ae47409036 req-d148d8b9-6474-48a7-b65e-fbe9ec859954 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:54:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7176MB free_disk=24.856082916259766GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-096bd2bc-dc7a-4332-abc1-95ae47409036 req-d148d8b9-6474-48a7-b65e-fbe9ec859954 service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Detach interface failed, port_id=ce1f1809-0c98-4469-a733-6bf3ccd594e3, reason: Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:54:06 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Took 0.51 seconds to deallocate network for instance.
Nov 15 05:54:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0aea1f03-161c-4b04-bee9-e0453ac6a110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 878ae6df-048e-4181-895e-64ad390935dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cad9c255-6774-4949-940a-df74f84d3feb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 64004f1c-2f3f-4d02-8632-823a13493b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cfba25df-06bc-4064-a681-e39c39bff579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 84676ebd-9adb-45fb-8efb-55079478860b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.656s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.551s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:54:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:07 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Deleted allocations for instance 0aea1f03-161c-4b04-bee9-e0453ac6a110
Nov 15 05:54:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-142f9b5a-5bd2-400a-af07-a82e61146616 tempest-ServersNegativeTestJSON-1712721745 tempest-ServersNegativeTestJSON-1712721745-project-member] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.505s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-34dc811c-1af8-4d2b-8e58-a824f97b330f req-611f0a9a-1247-4ab5-90ba-fb240a3a93fd service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received event network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-34dc811c-1af8-4d2b-8e58-a824f97b330f req-611f0a9a-1247-4ab5-90ba-fb240a3a93fd service nova] Acquiring lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-34dc811c-1af8-4d2b-8e58-a824f97b330f req-611f0a9a-1247-4ab5-90ba-fb240a3a93fd service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-34dc811c-1af8-4d2b-8e58-a824f97b330f req-611f0a9a-1247-4ab5-90ba-fb240a3a93fd service nova] Lock "0aea1f03-161c-4b04-bee9-e0453ac6a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-34dc811c-1af8-4d2b-8e58-a824f97b330f req-611f0a9a-1247-4ab5-90ba-fb240a3a93fd service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] No waiting events found dispatching network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:08 user nova-compute[75648]: WARNING nova.compute.manager [req-34dc811c-1af8-4d2b-8e58-a824f97b330f req-611f0a9a-1247-4ab5-90ba-fb240a3a93fd service nova] [instance: 0aea1f03-161c-4b04-bee9-e0453ac6a110] Received unexpected event network-vif-plugged-ce1f1809-0c98-4469-a733-6bf3ccd594e3 for instance with vm_state deleted and task_state None.
Nov 15 05:54:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:54:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:15 user nova-compute[75648]: INFO nova.compute.manager [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Terminating instance
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-114bd009-a075-46d5-8525-45494abe7654 req-3e9f12d9-bcd2-4152-87e9-722679849e56 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-unplugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-114bd009-a075-46d5-8525-45494abe7654 req-3e9f12d9-bcd2-4152-87e9-722679849e56 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-114bd009-a075-46d5-8525-45494abe7654 req-3e9f12d9-bcd2-4152-87e9-722679849e56 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-114bd009-a075-46d5-8525-45494abe7654 req-3e9f12d9-bcd2-4152-87e9-722679849e56 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-114bd009-a075-46d5-8525-45494abe7654 req-3e9f12d9-bcd2-4152-87e9-722679849e56 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-unplugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-114bd009-a075-46d5-8525-45494abe7654 req-3e9f12d9-bcd2-4152-87e9-722679849e56 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-unplugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:54:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Instance destroyed successfully.
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lazy-loading 'resources' on Instance uuid 878ae6df-048e-4181-895e-64ad390935dc {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2017508956',display_name='tempest-TestMinimumBasicScenario-server-2017508956',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2017508956',id=34,image_ref='1120b825-9a59-4af3-a4d5-4b27ebd58b97',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAiDyPWIfAXks04V0IoUDVOhL6vJWjRzm5Z0ABHll8OxI5F/RtytWnFIq9hknNtzwBkNrE0+H6kEj5W1W+qNAhosRAQoquL4aEfFt9PqzL93mukg4ddeUor6ItV1S7/mMA==',key_name='tempest-TestMinimumBasicScenario-589473324',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:49:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abd3f0cb9d1048e899c02994b977bec3',ramdisk_id='',reservation_id='r-ji8sfzk2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1120b825-9a59-4af3-a4d5-4b27ebd58b97',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-623726925',owner_user_name='tempest-TestMinimumBasicScenario-623726925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:51:36Z,user_data=None,user_id='b0aa1627a1bf4e0abc6618d6ecbe5944',uuid=878ae6df-048e-4181-895e-64ad390935dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converting VIF {"id": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "address": "fa:16:3e:39:f8:f0", "network": {"id": "1a9a2539-7249-454b-8d50-57a47968ef57", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-565351123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abd3f0cb9d1048e899c02994b977bec3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61cc90ce-a6", "ovs_interfaceid": "61cc90ce-a6c4-41b5-869b-222e051f6c36", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG os_vif [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61cc90ce-a6, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b814afb9-f428-41b2-a9db-1a89f490b89d) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:15 user nova-compute[75648]: INFO os_vif [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:f8:f0,bridge_name='br-int',has_traffic_filtering=True,id=61cc90ce-a6c4-41b5-869b-222e051f6c36,network=Network(1a9a2539-7249-454b-8d50-57a47968ef57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61cc90ce-a6')
Nov 15 05:54:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Deleting instance files /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc_del
Nov 15 05:54:15 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Deletion of /opt/stack/data/nova/instances/878ae6df-048e-4181-895e-64ad390935dc_del complete
Nov 15 05:54:16 user nova-compute[75648]: INFO nova.compute.manager [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 05:54:16 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:54:16 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:54:16 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:54:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:16 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:16 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Took 0.65 seconds to deallocate network for instance.
Nov 15 05:54:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-5c453eb9-1ae7-4044-adfc-95026e0aa534 req-a2679e68-4118-4596-8203-4e84c2f2bc52 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-deleted-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'flavor' on Instance uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.502s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:17 user nova-compute[75648]: INFO nova.compute.manager [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attaching volume b6901133-2c39-4b86-9d2e-58a21eddcaec to /dev/vdb
Nov 15 05:54:17 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Deleted allocations for instance 878ae6df-048e-4181-895e-64ad390935dc
Nov 15 05:54:17 user nova-compute[75648]: DEBUG os_brick.utils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1efad9d-f8ac-45ce-bfa5-2a0174146801]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[43753472-fa8d-49d1-af54-3b26e5a517bb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d82ebf0a-1d19-4ccd-8803-24a5c8454fdf tempest-TestMinimumBasicScenario-623726925 tempest-TestMinimumBasicScenario-623726925-project-member] Lock "878ae6df-048e-4181-895e-64ad390935dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.210s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[132efcd1-8176-48f1-b227-dc03180db8ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfec15e-6679-40e6-bcf2-fa5ee38939d7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:17 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9290f4-a77c-4e1f-a958-c32ad9b9b1a7]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG os_brick.utils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updating existing volume attachment record: 681b3ba2-b059-4a7d-87bf-a9759604040e {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] Acquiring lock "878ae6df-048e-4181-895e-64ad390935dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] Lock "878ae6df-048e-4181-895e-64ad390935dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] No waiting events found dispatching network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:17 user nova-compute[75648]: WARNING nova.compute.manager [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: 878ae6df-048e-4181-895e-64ad390935dc] Received unexpected event network-vif-plugged-61cc90ce-a6c4-41b5-869b-222e051f6c36 for instance with vm_state deleted and task_state None.
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-changed-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Refreshing instance network info cache due to event network-changed-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] Acquiring lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] Acquired lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:54:17 user nova-compute[75648]: DEBUG nova.network.neutron [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Refreshing network info cache for port 738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:54:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updated VIF entry in instance network info cache for port 738f8ceb-3e09-4e7e-a54a-a6118d6df7ec. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:54:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updating instance_info_cache with network_info: [{"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-99fe9ae8-1bd3-4126-8060-90913479b6fb req-7ae7e607-d374-429e-89fc-8c68299a6f55 service nova] Releasing lock "refresh_cache-cfba25df-06bc-4064-a681-e39c39bff579" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:54:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:22 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:22 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:22 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0ddb2a-8a83-4405-b172-aa19745c7dc2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:54:22 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae945c6-ea0e-4d81-ac2b-07e3fd962916]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec] added
Nov 15 05:54:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7666511f-dbd1-423e-97c4-e975a919b187]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f65d556-43e3-4eec-8eec-17c4ecddb050]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKfWswXx {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKfWswXx" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea7b715-e85b-4731-9931-4e363387ce6f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKfWswXx'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9ca115-1743-4ae0-aa0b-5847b90891d5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[39044b20-c49f-4780-93f0-c25d72603e6e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:22 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:22 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --login" returned: 0 in 1.098s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1864d9-61c4-432e-9ebb-74d774d343bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]
Nov 15 05:54:23 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.
Nov 15 05:54:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed9e39a-cf09-47c9-a4bf-d92ade728ce3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcf76ba-00f8-4b2e-802c-cf5ca51aced5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:23 user nova-compute[75648]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.411s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18051205-8ebd-435f-b6e2-ff5ff5042f6b]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:54:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.447s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== connect_volume: return (2448ms) {'type': 'block', 'scsi_wwn': '26534313430303062', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534313430303062', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'flavor' on Instance uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:54:24 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:54:24 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:54:24 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:54:24 user nova-compute[75648]:   <serial>b6901133-2c39-4b86-9d2e-58a21eddcaec</serial>
Nov 15 05:54:24 user nova-compute[75648]: </disk>
Nov 15 05:54:24 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:54:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No VIF found with MAC fa:16:3e:24:1c:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:54:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a82897d8-b272-4abd-9bef-326ccb8b5653 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.830s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:27 user nova-compute[75648]: INFO nova.compute.manager [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Rebuilding instance
Nov 15 05:54:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:54:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance destroyed successfully.
Nov 15 05:54:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:28 user nova-compute[75648]: INFO nova.compute.manager [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Detaching volume b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:54:28 user nova-compute[75648]: INFO nova.virt.block_device [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attempting to driver detach volume b6901133-2c39-4b86-9d2e-58a21eddcaec from mountpoint /dev/vdb
Nov 15 05:54:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Attempting to detach device vdb from instance cfba25df-06bc-4064-a681-e39c39bff579 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:54:28 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:54:28 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:54:28 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:54:28 user nova-compute[75648]:   <serial>b6901133-2c39-4b86-9d2e-58a21eddcaec</serial>
Nov 15 05:54:28 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:54:28 user nova-compute[75648]: </disk>
Nov 15 05:54:28 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:54:28 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully detached device vdb from instance cfba25df-06bc-4064-a681-e39c39bff579 from the persistent domain config.
Nov 15 05:54:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:28 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[913291c0-08ad-43e2-90c8-790a41cead76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:54:28 user nova-compute[75648]: No targets found.
Nov 15 05:54:28 user nova-compute[75648]: iSNS:
Nov 15 05:54:28 user nova-compute[75648]: No targets found.
Nov 15 05:54:28 user nova-compute[75648]: STATIC:
Nov 15 05:54:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:54:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:54:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:54:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:54:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:54:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:28 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e
Nov 15 05:54:28 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:28 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:28 user nova-compute[75648]: FIRMWARE:
Nov 15 05:54:28 user nova-compute[75648]: No targets found.
Nov 15 05:54:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:54:28 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:54:28 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6944a964-5912-4d66-ae99-1c9650bbcc88]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[25369bd9-1fe5-42fa-bd68-d9df7869dfe0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:28 user nova-compute[75648]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47f7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a46aae3-d63f-45eb-b8fb-af04aa890269]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d869a124-58df-4cc1-9794-b21ace0b2240]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e019483-c4f4-4b51-9815-161bc5a67077]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[65904b55-5b52-4fd9-872f-31269da3bc7b]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3143375f-f9e9-49f0-a09c-aaf65856d541]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c1170b-97b5-498e-97b8-7ee6649723e3]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]
Nov 15 05:54:28 user nova-compute[75648]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.
Nov 15 05:54:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57650df-ba01-4f31-81db-61ad998f02eb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== disconnect_volume: return (335ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-915cd207-2882-4f4e-b32f-9d4bf69acde5 req-14e9e9a5-cd21-4b14-b131-486a9b767a14 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-unplugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-915cd207-2882-4f4e-b32f-9d4bf69acde5 req-14e9e9a5-cd21-4b14-b131-486a9b767a14 service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-915cd207-2882-4f4e-b32f-9d4bf69acde5 req-14e9e9a5-cd21-4b14-b131-486a9b767a14 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-915cd207-2882-4f4e-b32f-9d4bf69acde5 req-14e9e9a5-cd21-4b14-b131-486a9b767a14 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-915cd207-2882-4f4e-b32f-9d4bf69acde5 req-14e9e9a5-cd21-4b14-b131-486a9b767a14 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-unplugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:29 user nova-compute[75648]: WARNING nova.compute.manager [req-915cd207-2882-4f4e-b32f-9d4bf69acde5 req-14e9e9a5-cd21-4b14-b131-486a9b767a14 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-unplugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state active and task_state rebuilding.
Nov 15 05:54:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance destroyed successfully.
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1132664164',display_name='tempest-ServerActionsTestOtherA-server-534410716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1132664164',id=38,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrMHw6CVN46QndV4fLK/dkMsjkjJ2ANmwSPlQ0Jykvkn/AVvRx4HXNbGOOm/kpUKJjPVSvEqRr9l81gzdL3tBchJJzfye99ufgHezNwSfzUqXQBsIlWt9CtZzqyBs17ag==',key_name='tempest-keypair-822930759',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-ch1ya3rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:54:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=cfba25df-06bc-4064-a681-e39c39bff579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap738f8ceb-3e, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d67ff762-bf12-43f0-ae50-5b61cfb0994f) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:29 user nova-compute[75648]: INFO os_vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e')
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593b886-4184-4194-9edf-12d798b9bc66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:54:29 user nova-compute[75648]: No targets found.
Nov 15 05:54:29 user nova-compute[75648]: iSNS:
Nov 15 05:54:29 user nova-compute[75648]: No targets found.
Nov 15 05:54:29 user nova-compute[75648]: STATIC:
Nov 15 05:54:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:54:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:54:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:54:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:54:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e
Nov 15 05:54:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:29 user nova-compute[75648]: FIRMWARE:
Nov 15 05:54:29 user nova-compute[75648]: No targets found.
Nov 15 05:54:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:54:29 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:54:29 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7af01d9-1c0b-4fe7-8752-bfb618e4666e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5385d3-b518-47eb-bac2-5c74f988522c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:29 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9fa4d31c0>, {}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Disconnecting from: [] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.093s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== disconnect_volume: return (94ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:54:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Deleting instance files /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579_del
Nov 15 05:54:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Deletion of /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579_del complete
Nov 15 05:54:29 user nova-compute[75648]: INFO nova.virt.block_device [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Booting with volume b6901133-2c39-4b86-9d2e-58a21eddcaec at /dev/vdb
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.utils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[658a1d44-4af6-429c-a845-7016b7d1d319]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f192e-772a-4d71-9ebf-60307bb6772b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008de5b-6ce3-4b59-aa59-437db78bb90b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed7727b-f783-4ada-810a-1900eacd68ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:29 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:54:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe4c1d7-d839-43f9-94d5-290c6715dcf5]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG os_brick.utils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updating existing volume attachment record: 6403fe20-74d0-4ee0-b0f8-004feb773d0d {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:54:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-0f1c6e4d-5ec0-4ad0-8a16-6480c20da5ab req-180eb842-ba02-4d56-94cb-3e1728a5bcea service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0f1c6e4d-5ec0-4ad0-8a16-6480c20da5ab req-180eb842-ba02-4d56-94cb-3e1728a5bcea service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0f1c6e4d-5ec0-4ad0-8a16-6480c20da5ab req-180eb842-ba02-4d56-94cb-3e1728a5bcea service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0f1c6e4d-5ec0-4ad0-8a16-6480c20da5ab req-180eb842-ba02-4d56-94cb-3e1728a5bcea service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:31 user nova-compute[75648]: DEBUG nova.compute.manager [req-0f1c6e4d-5ec0-4ad0-8a16-6480c20da5ab req-180eb842-ba02-4d56-94cb-3e1728a5bcea service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:31 user nova-compute[75648]: WARNING nova.compute.manager [req-0f1c6e4d-5ec0-4ad0-8a16-6480c20da5ab req-180eb842-ba02-4d56-94cb-3e1728a5bcea service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state active and task_state rebuild_block_device_mapping.
Nov 15 05:54:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:54:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Creating image(s)
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk 1073741824" returned: 0 in 0.054s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:54:35 user nova-compute[75648]: INFO nova.compute.claims [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Claim successful on node user
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Cannot resize image /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Ensure instance console log exists: /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Start _get_guest_xml network_info=[{"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '6403fe20-74d0-4ee0-b0f8-004feb773d0d', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cfba25df-06bc-4064-a681-e39c39bff579', 'attached_at': '', 'detached_at': '', 'volume_id': 'b6901133-2c39-4b86-9d2e-58a21eddcaec', 'serial': 'b6901133-2c39-4b86-9d2e-58a21eddcaec'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:54:35 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 05:54:35 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:54:35 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'vcpu_model' on Instance uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:36 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:36 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:36 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbc2a14-271f-4bda-9c78-3bbf17e85ce0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:54:36 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[94870810-6eb0-4b64-a8f3-7a75ac584c48]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec] added
Nov 15 05:54:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a8484-605e-4bdf-b1a1-230070c86461]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fca97f3-bcb5-4314-a8bd-8e97199645de]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKfWswXx {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kKfWswXx" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[125470d5-8181-4614-9156-25fe5aae2a01]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kKfWswXx'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[149b4b81-c08d-412e-b0ae-ef1453b6361d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f705cb7d-4685-4f10-8dfb-522160387774]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d129f-edde-451f-b1b8-5ccabbc191b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]
Nov 15 05:54:36 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.
Nov 15 05:54:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea001c8-8930-4403-846d-0d7298d6bbd9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d0fcf0-206a-4e4b-8b6c-2178d7a989a6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:36 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:36 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14f228f-4143-4b55-83a3-13b25bce9c74]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.566s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:54:36 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.policy [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eb4b0c67e9cd4a3eb697f4d2b1668fb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bb07fa691bf94a7f8a85cd8edf71b795', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:54:36 user nova-compute[75648]: INFO nova.virt.block_device [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Booting with volume 1a179055-9e6f-4f14-9c27-dafa5e297715 at /dev/vda
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.utils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f1df21-f7d4-475f-88e2-81576b45a7ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe062b0c-0161-4ab2-93be-8a238955e143]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[73db5d8f-dc92-42d9-b354-3d04d34892fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[35324c0c-daa9-4552-bff2-b692800f47c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:36 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:54:36 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abafde0-d6ee-4f7e-a8ca-81b8a01d7bd6]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG os_brick.utils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:36 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating existing volume attachment record: dade2f00-3f10-478e-ba55-8d49f0f5be2c {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Successfully created port: 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== connect_volume: return (1355ms) {'type': 'block', 'scsi_wwn': '26534313430303062', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534313430303062', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1132664164',display_name='tempest-ServerActionsTestOtherA-server-534410716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1132664164',id=38,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrMHw6CVN46QndV4fLK/dkMsjkjJ2ANmwSPlQ0Jykvkn/AVvRx4HXNbGOOm/kpUKJjPVSvEqRr9l81gzdL3tBchJJzfye99ufgHezNwSfzUqXQBsIlWt9CtZzqyBs17ag==',key_name='tempest-keypair-822930759',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-ch1ya3rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=cfba25df-06bc-4064-a681-e39c39bff579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:54:37 user nova-compute[75648]:   <uuid>cfba25df-06bc-4064-a681-e39c39bff579</uuid>
Nov 15 05:54:37 user nova-compute[75648]:   <name>instance-00000026</name>
Nov 15 05:54:37 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:54:37 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:54:37 user nova-compute[75648]:   <metadata>
Nov 15 05:54:37 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:54:37 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:54:37 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherA-server-534410716</nova:name>
Nov 15 05:54:37 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:54:35</nova:creationTime>
Nov 15 05:54:37 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:54:37 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:54:37 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:54:37 user nova-compute[75648]:       <nova:owner>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:user uuid="5d61be40c2864afc99cd689efdb30308">tempest-ServerActionsTestOtherA-442850377-project-member</nova:user>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:project uuid="06bd3ce1caf14075b2d936ac45b143f5">tempest-ServerActionsTestOtherA-442850377</nova:project>
Nov 15 05:54:37 user nova-compute[75648]:       </nova:owner>
Nov 15 05:54:37 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:54:37 user nova-compute[75648]:       <nova:ports>
Nov 15 05:54:37 user nova-compute[75648]:         <nova:port uuid="738f8ceb-3e09-4e7e-a54a-a6118d6df7ec">
Nov 15 05:54:37 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 15 05:54:37 user nova-compute[75648]:         </nova:port>
Nov 15 05:54:37 user nova-compute[75648]:       </nova:ports>
Nov 15 05:54:37 user nova-compute[75648]:     </nova:instance>
Nov 15 05:54:37 user nova-compute[75648]:   </metadata>
Nov 15 05:54:37 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:54:37 user nova-compute[75648]:     <system>
Nov 15 05:54:37 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:54:37 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:54:37 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:54:37 user nova-compute[75648]:       <entry name="serial">cfba25df-06bc-4064-a681-e39c39bff579</entry>
Nov 15 05:54:37 user nova-compute[75648]:       <entry name="uuid">cfba25df-06bc-4064-a681-e39c39bff579</entry>
Nov 15 05:54:37 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:54:37 user nova-compute[75648]:     </system>
Nov 15 05:54:37 user nova-compute[75648]:   </sysinfo>
Nov 15 05:54:37 user nova-compute[75648]:   <os>
Nov 15 05:54:37 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:54:37 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:54:37 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:54:37 user nova-compute[75648]:   </os>
Nov 15 05:54:37 user nova-compute[75648]:   <features>
Nov 15 05:54:37 user nova-compute[75648]:     <acpi/>
Nov 15 05:54:37 user nova-compute[75648]:     <apic/>
Nov 15 05:54:37 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:54:37 user nova-compute[75648]:   </features>
Nov 15 05:54:37 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:54:37 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:54:37 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:54:37 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:54:37 user nova-compute[75648]:   </clock>
Nov 15 05:54:37 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:54:37 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:54:37 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:54:37 user nova-compute[75648]:   </cpu>
Nov 15 05:54:37 user nova-compute[75648]:   <devices>
Nov 15 05:54:37 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:54:37 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:54:37 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk"/>
Nov 15 05:54:37 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:54:37 user nova-compute[75648]:     </disk>
Nov 15 05:54:37 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:54:37 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:54:37 user nova-compute[75648]:       <source dev="/dev/sde"/>
Nov 15 05:54:37 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:54:37 user nova-compute[75648]:       <serial>b6901133-2c39-4b86-9d2e-58a21eddcaec</serial>
Nov 15 05:54:37 user nova-compute[75648]:     </disk>
Nov 15 05:54:37 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:54:37 user nova-compute[75648]:       <mac address="fa:16:3e:24:1c:02"/>
Nov 15 05:54:37 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:54:37 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:54:37 user nova-compute[75648]:       <target dev="tap738f8ceb-3e"/>
Nov 15 05:54:37 user nova-compute[75648]:     </interface>
Nov 15 05:54:37 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:54:37 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/console.log" append="off"/>
Nov 15 05:54:37 user nova-compute[75648]:     </serial>
Nov 15 05:54:37 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:54:37 user nova-compute[75648]:     <video>
Nov 15 05:54:37 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:54:37 user nova-compute[75648]:     </video>
Nov 15 05:54:37 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:54:37 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:54:37 user nova-compute[75648]:     </rng>
Nov 15 05:54:37 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:54:37 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:54:37 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:54:37 user nova-compute[75648]:     </memballoon>
Nov 15 05:54:37 user nova-compute[75648]:   </devices>
Nov 15 05:54:37 user nova-compute[75648]: </domain>
Nov 15 05:54:37 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1132664164',display_name='tempest-ServerActionsTestOtherA-server-534410716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1132664164',id=38,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrMHw6CVN46QndV4fLK/dkMsjkjJ2ANmwSPlQ0Jykvkn/AVvRx4HXNbGOOm/kpUKJjPVSvEqRr9l81gzdL3tBchJJzfye99ufgHezNwSfzUqXQBsIlWt9CtZzqyBs17ag==',key_name='tempest-keypair-822930759',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:52:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-ch1ya3rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=cfba25df-06bc-4064-a681-e39c39bff579,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG os_vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d7989e6-7fbf-52ca-b07e-63214d82bbbc', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap738f8ceb-3e, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap738f8ceb-3e, col_values=(('qos', UUID('0c3b0c18-9647-47ae-a9c6-74145a4fbef1')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap738f8ceb-3e, col_values=(('external_ids', {'iface-id': '738f8ceb-3e09-4e7e-a54a-a6118d6df7ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:1c:02', 'vm-uuid': 'cfba25df-06bc-4064-a681-e39c39bff579'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:37 user nova-compute[75648]: INFO os_vif [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e')
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:54:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No VIF found with MAC fa:16:3e:24:1c:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Successfully updated port: 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing instance network info cache due to event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance network_info: |[{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updated VIF entry in instance network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:54:38 user nova-compute[75648]: DEBUG nova.network.neutron [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae265565-ccbd-4f46-a5a2-af0a6d535fe8 req-86621ed8-ae33-4145-b848-fcb9455491a8 service nova] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:54:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:40 user nova-compute[75648]: WARNING nova.compute.manager [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state active and task_state rebuild_spawning.
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:40 user nova-compute[75648]: WARNING nova.compute.manager [req-f6d1083d-9512-4c46-b21a-740fdc327a3e req-df538ad5-9fb9-4389-abd1-8d882db6ef10 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state active and task_state rebuild_spawning.
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:54:40 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance spawned successfully.
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75648) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8aab2aa1-b5e5-479a-a3f7-12c0f6f1fe76 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:54:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Creating image(s)
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Ensure instance console log exists: /opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Start _get_guest_xml network_info=[{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': 'dade2f00-3f10-478e-ba55-8d49f0f5be2c', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf4097a-b7f0-4802-8abc-2583acd8ab84', 'attached_at': '', 'detached_at': '', 'volume_id': '1a179055-9e6f-4f14-9c27-dafa5e297715', 'serial': '1a179055-9e6f-4f14-9c27-dafa5e297715'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:54:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:54:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:41 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:41 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:41 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[79749764-8bc2-4768-9cb6-74ea5b4c1f09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:54:41 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8586f2f2-12b8-4b9b-bf16-b533ee71cbe1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715] added
Nov 15 05:54:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58eb4b5-6957-419a-8211-8f779c5dc16f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2593ff56-c165-413b-a40a-2735ff8cd815]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgQmtAJM {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgQmtAJM" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf44302-e350-4ffa-9d97-df99a4660af2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgQmtAJM'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[663b7466-d3e7-47f5-84d5-753d4764a9d0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e637004-cee1-47a0-8510-05e25e369882]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3f143f-5df3-4ebe-8490-7b02c4594b41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]
Nov 15 05:54:42 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.
Nov 15 05:54:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98138a6-6bf3-4f5c-bb06-45b5f2b9e911]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e76ef54-fce6-4d79-8fe5-60ef401fb54d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:54:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:42 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:54:42 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] HCTL ('39', '-', '-', 0) found on session 40 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb661ba-ac96-4bcf-9154-07d15f6c995c]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Searching for a device in session 40 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:42 user nova-compute[75648]: INFO nova.compute.manager [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Terminating instance
Nov 15 05:54:42 user nova-compute[75648]: DEBUG nova.compute.manager [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-feee78f2-f8d7-45f1-97bb-b1b4990f2762 req-0d1f4189-0fa7-4945-8532-042da3a8a2a6 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-feee78f2-f8d7-45f1-97bb-b1b4990f2762 req-0d1f4189-0fa7-4945-8532-042da3a8a2a6 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-feee78f2-f8d7-45f1-97bb-b1b4990f2762 req-0d1f4189-0fa7-4945-8532-042da3a8a2a6 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-feee78f2-f8d7-45f1-97bb-b1b4990f2762 req-0d1f4189-0fa7-4945-8532-042da3a8a2a6 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-feee78f2-f8d7-45f1-97bb-b1b4990f2762 req-0d1f4189-0fa7-4945-8532-042da3a8a2a6 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-feee78f2-f8d7-45f1-97bb-b1b4990f2762 req-0d1f4189-0fa7-4945-8532-042da3a8a2a6 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-unplugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:54:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Instance destroyed successfully.
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.objects.instance [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lazy-loading 'resources' on Instance uuid cad9c255-6774-4949-940a-df74f84d3feb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:46:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-2035674182',display_name='tempest-ServerActionsTestOtherB-server-2035674182',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-2035674182',id=25,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOc2+avFLm4jS+C6R3i+uznupTuuFnPAZ8nmPzcOythN1lw51/RzGtzou9phYGfeSWxSXBpeXn2DCy9GPLYbEDzRaDH8FgVB/hdWAfIz6d5+AmA5Oy0mImWUjt6k6HbX6Q==',key_name='tempest-keypair-812960404',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='915d7e6dbaaa42bf9100917ef6ce0824',ramdisk_id='',reservation_id='r-1utjh1ux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1116144874',owner_user_name='tempest-ServerActionsTestOtherB-1116144874-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:52:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='306a53f7ef404302b5d26be66e11562f',uuid=cad9c255-6774-4949-940a-df74f84d3feb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converting VIF {"id": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "address": "fa:16:3e:9a:5e:31", "network": {"id": "2cb7c509-130b-4907-bef7-fd2521f1e2f3", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-254289440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "915d7e6dbaaa42bf9100917ef6ce0824", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5e72138-d2", "ovs_interfaceid": "c5e72138-d273-4bb1-ac14-8e5f88e04114", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_vif [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5e72138-d2, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7aaaf0b3-9e50-455a-a31f-091fc24aeace) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: INFO os_vif [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:5e:31,bridge_name='br-int',has_traffic_filtering=True,id=c5e72138-d273-4bb1-ac14-8e5f88e04114,network=Network(2cb7c509-130b-4907-bef7-fd2521f1e2f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5e72138-d2')
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PTUVYEDj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '26464306534616137', 'path': '/dev/sdh'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306534616137', 'path': '/dev/sdh'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.113s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09bd251-f4ed-4a50-851a-90541bc6c261]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:54:43 user nova-compute[75648]: No targets found.
Nov 15 05:54:43 user nova-compute[75648]: iSNS:
Nov 15 05:54:43 user nova-compute[75648]: No targets found.
Nov 15 05:54:43 user nova-compute[75648]: STATIC:
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e
Nov 15 05:54:43 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:54:43 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:54:43 user nova-compute[75648]: FIRMWARE:
Nov 15 05:54:43 user nova-compute[75648]: No targets found.
Nov 15 05:54:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:54:43 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:54:43 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1341763353',display_name='tempest-TestShelveInstance-server-1341763353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1341763353',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq2HhlG5b9x0nJmzt8cepOedKjawpG0QLkzmrdDlBep6Zc8jxWnSTc5rjLZuhnzrpPjTv2R+//hXw0zmXOJ388Xh8J0UmhI83aCpX0khAF+L+9zAZSkhoniuwIXfVD08A==',key_name='tempest-TestShelveInstance-1044638316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb07fa691bf94a7f8a85cd8edf71b795',ramdisk_id='',reservation_id='r-2r401zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-812316993',owner_user_name='tempest-TestShelveInstance-812316993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:54:37Z,user_data=None,user_id='eb4b0c67e9cd4a3eb697f4d2b1668fb6',uuid=fdf4097a-b7f0-4802-8abc-2583acd8ab84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converting VIF {"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'pci_devices' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:54:43 user nova-compute[75648]:   <uuid>fdf4097a-b7f0-4802-8abc-2583acd8ab84</uuid>
Nov 15 05:54:43 user nova-compute[75648]:   <name>instance-00000029</name>
Nov 15 05:54:43 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:54:43 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:54:43 user nova-compute[75648]:   <metadata>
Nov 15 05:54:43 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:54:43 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:54:43 user nova-compute[75648]:       <nova:name>tempest-TestShelveInstance-server-1341763353</nova:name>
Nov 15 05:54:43 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:54:41</nova:creationTime>
Nov 15 05:54:43 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:54:43 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:54:43 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:54:43 user nova-compute[75648]:       <nova:owner>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:user uuid="eb4b0c67e9cd4a3eb697f4d2b1668fb6">tempest-TestShelveInstance-812316993-project-member</nova:user>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:project uuid="bb07fa691bf94a7f8a85cd8edf71b795">tempest-TestShelveInstance-812316993</nova:project>
Nov 15 05:54:43 user nova-compute[75648]:       </nova:owner>
Nov 15 05:54:43 user nova-compute[75648]:       <nova:ports>
Nov 15 05:54:43 user nova-compute[75648]:         <nova:port uuid="9de3a7e3-3152-4276-bd9e-d3ddfcac0696">
Nov 15 05:54:43 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:54:43 user nova-compute[75648]:         </nova:port>
Nov 15 05:54:43 user nova-compute[75648]:       </nova:ports>
Nov 15 05:54:43 user nova-compute[75648]:     </nova:instance>
Nov 15 05:54:43 user nova-compute[75648]:   </metadata>
Nov 15 05:54:43 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:54:43 user nova-compute[75648]:     <system>
Nov 15 05:54:43 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:54:43 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:54:43 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:54:43 user nova-compute[75648]:       <entry name="serial">fdf4097a-b7f0-4802-8abc-2583acd8ab84</entry>
Nov 15 05:54:43 user nova-compute[75648]:       <entry name="uuid">fdf4097a-b7f0-4802-8abc-2583acd8ab84</entry>
Nov 15 05:54:43 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:54:43 user nova-compute[75648]:     </system>
Nov 15 05:54:43 user nova-compute[75648]:   </sysinfo>
Nov 15 05:54:43 user nova-compute[75648]:   <os>
Nov 15 05:54:43 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:54:43 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:54:43 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:54:43 user nova-compute[75648]:   </os>
Nov 15 05:54:43 user nova-compute[75648]:   <features>
Nov 15 05:54:43 user nova-compute[75648]:     <acpi/>
Nov 15 05:54:43 user nova-compute[75648]:     <apic/>
Nov 15 05:54:43 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:54:43 user nova-compute[75648]:   </features>
Nov 15 05:54:43 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:54:43 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:54:43 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:54:43 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:54:43 user nova-compute[75648]:   </clock>
Nov 15 05:54:43 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:54:43 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:54:43 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:54:43 user nova-compute[75648]:   </cpu>
Nov 15 05:54:43 user nova-compute[75648]:   <devices>
Nov 15 05:54:43 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:54:43 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:54:43 user nova-compute[75648]:       <source dev="/dev/sdh"/>
Nov 15 05:54:43 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:54:43 user nova-compute[75648]:       <serial>1a179055-9e6f-4f14-9c27-dafa5e297715</serial>
Nov 15 05:54:43 user nova-compute[75648]:     </disk>
Nov 15 05:54:43 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:54:43 user nova-compute[75648]:       <mac address="fa:16:3e:09:53:8c"/>
Nov 15 05:54:43 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:54:43 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:54:43 user nova-compute[75648]:       <target dev="tap9de3a7e3-31"/>
Nov 15 05:54:43 user nova-compute[75648]:     </interface>
Nov 15 05:54:43 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:54:43 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84/console.log" append="off"/>
Nov 15 05:54:43 user nova-compute[75648]:     </serial>
Nov 15 05:54:43 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:54:43 user nova-compute[75648]:     <video>
Nov 15 05:54:43 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:54:43 user nova-compute[75648]:     </video>
Nov 15 05:54:43 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:54:43 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:54:43 user nova-compute[75648]:     </rng>
Nov 15 05:54:43 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:54:43 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:54:43 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:54:43 user nova-compute[75648]:     </memballoon>
Nov 15 05:54:43 user nova-compute[75648]:   </devices>
Nov 15 05:54:43 user nova-compute[75648]: </domain>
Nov 15 05:54:43 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1341763353',display_name='tempest-TestShelveInstance-server-1341763353',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1341763353',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq2HhlG5b9x0nJmzt8cepOedKjawpG0QLkzmrdDlBep6Zc8jxWnSTc5rjLZuhnzrpPjTv2R+//hXw0zmXOJ388Xh8J0UmhI83aCpX0khAF+L+9zAZSkhoniuwIXfVD08A==',key_name='tempest-TestShelveInstance-1044638316',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bb07fa691bf94a7f8a85cd8edf71b795',ramdisk_id='',reservation_id='r-2r401zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-812316993',owner_user_name='tempest-TestShelveInstance-812316993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:54:37Z,user_data=None,user_id='eb4b0c67e9cd4a3eb697f4d2b1668fb6',uuid=fdf4097a-b7f0-4802-8abc-2583acd8ab84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converting VIF {"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_vif [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b6765e-03af-48e2-928b-a5b1c9a64cac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ad1070d-d490-5f06-8bba-03a847e27045', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9de3a7e3-31, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9de3a7e3-31, col_values=(('qos', UUID('574a8c9b-f549-4637-91d6-ed9f0d2ca2f8')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9de3a7e3-31, col_values=(('external_ids', {'iface-id': '9de3a7e3-3152-4276-bd9e-d3ddfcac0696', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:53:8c', 'vm-uuid': 'fdf4097a-b7f0-4802-8abc-2583acd8ab84'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:43 user nova-compute[75648]: INFO os_vif [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31')
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5ca578-eb2b-4e33-94c6-8aaa4d18bf35]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:54:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:54:43 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:54:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e86b6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa471b1-3806-46ca-b969-52fb1fe5b2f3]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] No VIF found with MAC fa:16:3e:09:53:8c, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43284c6-8746-40df-8174-b7faf717c9ae]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf6c77d-8d50-445f-a5a8-0eb700dafb27]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d36f53b-4db2-4781-8d15-aae45ff715e4]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb09bec-2ada-48ce-9329-3dd065996bf1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e05985-10f9-4e57-89fb-606920abd209]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260]
Nov 15 05:54:43 user nova-compute[75648]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d, portal: 172.16.0.220,3260] successful.
Nov 15 05:54:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50879f6c-d4f9-45d9-b06a-e176925f814d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[244c1526-7cb0-47fa-9104-511b3ee6fa90]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] <== disconnect_volume: return (497ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:54:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Deleting instance files /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb_del
Nov 15 05:54:43 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Deletion of /opt/stack/data/nova/instances/cad9c255-6774-4949-940a-df74f84d3feb_del complete
Nov 15 05:54:43 user nova-compute[75648]: INFO nova.compute.manager [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Took 1.40 seconds to destroy the instance on the hypervisor.
Nov 15 05:54:43 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:54:43 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:44 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Took 0.76 seconds to deallocate network for instance.
Nov 15 05:54:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-415e4b88-a2ec-4e42-9aa6-e15f99efa79f req-939f2fcd-de57-406d-a901-b25d1a6c420e service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-deleted-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-4f90edfc-5a74-43ee-af09-281ca7bc83b2 req-68316e43-ad15-4476-9827-81fcf0720731 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4f90edfc-5a74-43ee-af09-281ca7bc83b2 req-68316e43-ad15-4476-9827-81fcf0720731 service nova] Acquiring lock "cad9c255-6774-4949-940a-df74f84d3feb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4f90edfc-5a74-43ee-af09-281ca7bc83b2 req-68316e43-ad15-4476-9827-81fcf0720731 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4f90edfc-5a74-43ee-af09-281ca7bc83b2 req-68316e43-ad15-4476-9827-81fcf0720731 service nova] Lock "cad9c255-6774-4949-940a-df74f84d3feb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-4f90edfc-5a74-43ee-af09-281ca7bc83b2 req-68316e43-ad15-4476-9827-81fcf0720731 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] No waiting events found dispatching network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:44 user nova-compute[75648]: WARNING nova.compute.manager [req-4f90edfc-5a74-43ee-af09-281ca7bc83b2 req-68316e43-ad15-4476-9827-81fcf0720731 service nova] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Received unexpected event network-vif-plugged-c5e72138-d273-4bb1-ac14-8e5f88e04114 for instance with vm_state active and task_state deleting.
Nov 15 05:54:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-75c8b4f3-64d5-4967-98fe-60bb3207f1bb req-601c6486-62ba-40ce-abcf-1d910bb22c4a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-75c8b4f3-64d5-4967-98fe-60bb3207f1bb req-601c6486-62ba-40ce-abcf-1d910bb22c4a service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-75c8b4f3-64d5-4967-98fe-60bb3207f1bb req-601c6486-62ba-40ce-abcf-1d910bb22c4a service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-75c8b4f3-64d5-4967-98fe-60bb3207f1bb req-601c6486-62ba-40ce-abcf-1d910bb22c4a service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-75c8b4f3-64d5-4967-98fe-60bb3207f1bb req-601c6486-62ba-40ce-abcf-1d910bb22c4a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:45 user nova-compute[75648]: WARNING nova.compute.manager [req-75c8b4f3-64d5-4967-98fe-60bb3207f1bb req-601c6486-62ba-40ce-abcf-1d910bb22c4a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state building and task_state spawning.
Nov 15 05:54:45 user nova-compute[75648]: INFO nova.compute.manager [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] [instance: cad9c255-6774-4949-940a-df74f84d3feb] Took 0.78 seconds to detach 1 volumes for instance.
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:45 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Deleted allocations for instance cad9c255-6774-4949-940a-df74f84d3feb
Nov 15 05:54:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-213268c8-720e-45f3-be34-3b43ad4336ed tempest-ServerActionsTestOtherB-1116144874 tempest-ServerActionsTestOtherB-1116144874-project-member] Lock "cad9c255-6774-4949-940a-df74f84d3feb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.611s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:54:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance spawned successfully.
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:54:47 user nova-compute[75648]: INFO nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Took 5.27 seconds to spawn the instance on the hypervisor.
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-8d490cd9-2ea3-4bbf-b3d4-66acdad91eb7 req-69c66187-975e-4b0f-92d5-260c303f49d4 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8d490cd9-2ea3-4bbf-b3d4-66acdad91eb7 req-69c66187-975e-4b0f-92d5-260c303f49d4 service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8d490cd9-2ea3-4bbf-b3d4-66acdad91eb7 req-69c66187-975e-4b0f-92d5-260c303f49d4 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8d490cd9-2ea3-4bbf-b3d4-66acdad91eb7 req-69c66187-975e-4b0f-92d5-260c303f49d4 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-8d490cd9-2ea3-4bbf-b3d4-66acdad91eb7 req-69c66187-975e-4b0f-92d5-260c303f49d4 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:47 user nova-compute[75648]: WARNING nova.compute.manager [req-8d490cd9-2ea3-4bbf-b3d4-66acdad91eb7 req-69c66187-975e-4b0f-92d5-260c303f49d4 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state building and task_state spawning.
Nov 15 05:54:47 user nova-compute[75648]: INFO nova.compute.manager [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Took 11.41 seconds to build instance.
Nov 15 05:54:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4b9583bd-1d17-4f93-95f4-4719475e6372 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.570s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:51 user nova-compute[75648]: INFO nova.compute.manager [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Terminating instance
Nov 15 05:54:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-ac9f570a-1a74-4a84-8a3b-9dda4fa58ca3 req-8bf824e0-df5d-4ea0-a2b1-7d76f4b517ec service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-unplugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ac9f570a-1a74-4a84-8a3b-9dda4fa58ca3 req-8bf824e0-df5d-4ea0-a2b1-7d76f4b517ec service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ac9f570a-1a74-4a84-8a3b-9dda4fa58ca3 req-8bf824e0-df5d-4ea0-a2b1-7d76f4b517ec service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ac9f570a-1a74-4a84-8a3b-9dda4fa58ca3 req-8bf824e0-df5d-4ea0-a2b1-7d76f4b517ec service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-ac9f570a-1a74-4a84-8a3b-9dda4fa58ca3 req-8bf824e0-df5d-4ea0-a2b1-7d76f4b517ec service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-unplugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-ac9f570a-1a74-4a84-8a3b-9dda4fa58ca3 req-8bf824e0-df5d-4ea0-a2b1-7d76f4b517ec service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-unplugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Instance destroyed successfully.
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'resources' on Instance uuid 50d2b30f-82e8-46fe-8a7b-f227ba756995 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1801397757',display_name='tempest-ServerRescueNegativeTestJSON-server-1801397757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1801397757',id=3,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:40:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-ictjapfy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:51Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=50d2b30f-82e8-46fe-8a7b-f227ba756995,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "2322248d-0c65-4479-a167-4070d5a5d87e", "address": "fa:16:3e:a5:f2:32", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2322248d-0c", "ovs_interfaceid": "2322248d-0c65-4479-a167-4070d5a5d87e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG os_vif [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2322248d-0c, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1df1faf-bb69-4a3e-a2ed-582293489580) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:52 user nova-compute[75648]: INFO os_vif [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:f2:32,bridge_name='br-int',has_traffic_filtering=True,id=2322248d-0c65-4479-a167-4070d5a5d87e,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2322248d-0c')
Nov 15 05:54:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Deleting instance files /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995_del
Nov 15 05:54:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Deletion of /opt/stack/data/nova/instances/50d2b30f-82e8-46fe-8a7b-f227ba756995_del complete
Nov 15 05:54:52 user nova-compute[75648]: INFO nova.compute.manager [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 15 05:54:52 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-changed-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Refreshing instance network info cache due to event network-changed-da0d7513-b660-42e8-9bfd-fcaa36bdff7f. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] Acquiring lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] Acquired lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Refreshing network info cache for port da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:52 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Took 0.55 seconds to deallocate network for instance.
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-35f088b5-e8ad-4961-b38b-07e07c5125f3 req-d3ec08d3-f855-4831-9b82-e733befeebd7 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-deleted-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:52 user nova-compute[75648]: INFO nova.compute.manager [req-35f088b5-e8ad-4961-b38b-07e07c5125f3 req-d3ec08d3-f855-4831-9b82-e733befeebd7 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Neutron deleted interface 2322248d-0c65-4479-a167-4070d5a5d87e; detaching it from the instance and deleting it from the info cache
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.network.neutron [req-35f088b5-e8ad-4961-b38b-07e07c5125f3 req-d3ec08d3-f855-4831-9b82-e733befeebd7 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:52 user nova-compute[75648]: DEBUG nova.compute.manager [req-35f088b5-e8ad-4961-b38b-07e07c5125f3 req-d3ec08d3-f855-4831-9b82-e733befeebd7 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Detach interface failed, port_id=2322248d-0c65-4479-a167-4070d5a5d87e, reason: Instance 50d2b30f-82e8-46fe-8a7b-f227ba756995 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG nova.network.neutron [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updated VIF entry in instance network info cache for port da0d7513-b660-42e8-9bfd-fcaa36bdff7f. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG nova.network.neutron [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updating instance_info_cache with network_info: [{"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c9343446-106f-4dc9-8de4-3da3c432d8b2 req-ddcc1e1d-8bee-47b1-99b6-ed0084133092 service nova] Releasing lock "refresh_cache-7b7a666d-f7cb-4550-a21b-f843323e40e0" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.505s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:53 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Deleted allocations for instance 50d2b30f-82e8-46fe-8a7b-f227ba756995
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9ab3664e-be70-45c5-a96d-4eb40dfebf65 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.229s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-977b843d-5398-4039-9451-b4d67b1f38bd req-efca4d53-edf0-46cd-ae20-8eff82b4a045 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-977b843d-5398-4039-9451-b4d67b1f38bd req-efca4d53-edf0-46cd-ae20-8eff82b4a045 service nova] Acquiring lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-977b843d-5398-4039-9451-b4d67b1f38bd req-efca4d53-edf0-46cd-ae20-8eff82b4a045 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-977b843d-5398-4039-9451-b4d67b1f38bd req-efca4d53-edf0-46cd-ae20-8eff82b4a045 service nova] Lock "50d2b30f-82e8-46fe-8a7b-f227ba756995-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:53 user nova-compute[75648]: DEBUG nova.compute.manager [req-977b843d-5398-4039-9451-b4d67b1f38bd req-efca4d53-edf0-46cd-ae20-8eff82b4a045 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] No waiting events found dispatching network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:53 user nova-compute[75648]: WARNING nova.compute.manager [req-977b843d-5398-4039-9451-b4d67b1f38bd req-efca4d53-edf0-46cd-ae20-8eff82b4a045 service nova] [instance: 50d2b30f-82e8-46fe-8a7b-f227ba756995] Received unexpected event network-vif-plugged-2322248d-0c65-4479-a167-4070d5a5d87e for instance with vm_state deleted and task_state None.
Nov 15 05:54:54 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:54 user nova-compute[75648]: INFO nova.compute.manager [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Attaching volume 5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 to /dev/vdb
Nov 15 05:54:55 user nova-compute[75648]: DEBUG os_brick.utils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[852ebad1-edc0-4cc8-87d5-487cc047fb63]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a390bd2d-4d45-45ad-96ff-c560422fbcbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8291ee1f-0907-47a7-891a-bb51ee7f8894]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e079be49-a7f3-47a6-9481-5bc4f399e8a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:54:55 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf33bf5c-310f-40f7-aafb-3dc931f68058]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG os_brick.utils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updating existing volume attachment record: 775a34be-e9e5-45e4-b0f1-c6ef552c34e0 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:54:55 user nova-compute[75648]: INFO nova.compute.manager [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Unrescuing
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquired lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updating instance_info_cache with network_info: [{"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Releasing lock "refresh_cache-64004f1c-2f3f-4d02-8632-823a13493b17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:54:55 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'flavor' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-cf0c6358-c973-4cee-8b1b-9a6be52da971 req-8ffc267d-38f0-4b91-98df-9c78983cb25d service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cf0c6358-c973-4cee-8b1b-9a6be52da971 req-8ffc267d-38f0-4b91-98df-9c78983cb25d service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cf0c6358-c973-4cee-8b1b-9a6be52da971 req-8ffc267d-38f0-4b91-98df-9c78983cb25d service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cf0c6358-c973-4cee-8b1b-9a6be52da971 req-8ffc267d-38f0-4b91-98df-9c78983cb25d service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-cf0c6358-c973-4cee-8b1b-9a6be52da971 req-8ffc267d-38f0-4b91-98df-9c78983cb25d service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:56 user nova-compute[75648]: WARNING nova.compute.manager [req-cf0c6358-c973-4cee-8b1b-9a6be52da971 req-8ffc267d-38f0-4b91-98df-9c78983cb25d service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:54:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:56 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance destroyed successfully.
Nov 15 05:54:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-c64d1c25-3c47-4d43-b336-f8c3798e7a7d req-66c55624-54d0-48e1-8b83-43ac9dea497a service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c64d1c25-3c47-4d43-b336-f8c3798e7a7d req-66c55624-54d0-48e1-8b83-43ac9dea497a service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c64d1c25-3c47-4d43-b336-f8c3798e7a7d req-66c55624-54d0-48e1-8b83-43ac9dea497a service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c64d1c25-3c47-4d43-b336-f8c3798e7a7d req-66c55624-54d0-48e1-8b83-43ac9dea497a service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-c64d1c25-3c47-4d43-b336-f8c3798e7a7d req-66c55624-54d0-48e1-8b83-43ac9dea497a service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:54:58 user nova-compute[75648]: WARNING nova.compute.manager [req-c64d1c25-3c47-4d43-b336-f8c3798e7a7d req-66c55624-54d0-48e1-8b83-43ac9dea497a service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:54:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgdBuHeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:54:59 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:59 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:54:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:54:59 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:54:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3744a735-a512-41b0-8416-20faa7f64676]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:54:59 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:54:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[351dcd02-8101-4931-8c21-8f7c77d2ffb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4] added
Nov 15 05:55:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e0b5e9-ef1d-487c-9228-54b81ffc9a67]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b84bb9f-ba9b-4830-b428-5b66fc11b122]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgdBuHeK {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AgdBuHeK" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2afbe05-c3d5-4cdb-9edc-de08c835c110]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AgdBuHeK'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e629cba3-cdc4-4ad8-b89f-cbe9d503066f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60e9ee0-afbe-47d8-b1b2-d69e400b2afc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:55:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:55:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1666c66-4894-4932-b006-50eaeb99346a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260]
Nov 15 05:55:00 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260] successful.
Nov 15 05:55:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f072a6d-4a06-42c2-b455-1ec2ed871d88]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31be38f-f433-4939-8d3d-fb13651b378f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:55:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:55:00 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:55:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f013b3ed-d103-4114-a3d2-b072c0359012 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:00 user nova-compute[75648]: WARNING nova.compute.manager [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:00 user nova-compute[75648]: WARNING nova.compute.manager [req-0c0f21b3-9e7e-4da3-99c3-85c7c2eab233 req-dd0eaf7e-3b2d-4874-beda-69f49f616f56 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state rescued and task_state unrescuing.
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.466s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[932fa989-8e33-48e6-97dd-00743fa17f4d]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:00 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Updating instance_info_cache with network_info: [{"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-94a41326-1559-42e7-a95f-9e86259b26ef" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgdBuHeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.813s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== connect_volume: return (1815ms) {'type': 'block', 'scsi_wwn': '23737646563353435', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737646563353435', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:55:01 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:55:01 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:55:01 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:55:01 user nova-compute[75648]:   <serial>5c00e9c3-3229-47c5-82f7-2ae1085ff5d4</serial>
Nov 15 05:55:01 user nova-compute[75648]: </disk>
Nov 15 05:55:01 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:37:5c:91, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6b40f9fc-4544-4d35-bbd3-caa9e1d2fb10 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.524s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:55:04 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:04 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7579MB free_disk=24.956714630126953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c6859cea-129c-472b-aba0-b609ddc5f89a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 64004f1c-2f3f-4d02-8632-823a13493b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cfba25df-06bc-4064-a681-e39c39bff579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 84676ebd-9adb-45fb-8efb-55079478860b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fdf4097a-b7f0-4802-8abc-2583acd8ab84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e7501fb9-059b-4dad-948f-6779891e0e58 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "e7501fb9-059b-4dad-948f-6779891e0e58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.930s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.406s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 05:55:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:55:05 user nova-compute[75648]: INFO nova.compute.claims [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Claim successful on node user
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:55:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.policy [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f995cb1428a414d91dd043e1c53d130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06304608934649daab8dc8e603b9a446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:55:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Creating image(s)
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.255s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk 1073741824" returned: 0 in 0.058s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Cannot resize image /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Ensure instance console log exists: /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Successfully created port: 0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Successfully updated port: 0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquired lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-changed-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Refreshing instance network info cache due to event network-changed-0a50a2d2-525f-46dc-be05-dc1339bbd1c2. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] Acquiring lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Updating instance_info_cache with network_info: [{"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Releasing lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Instance network_info: |[{"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] Acquired lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.neutron [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Refreshing network info cache for port 0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Start _get_guest_xml network_info=[{"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:55:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1329161386',display_name='tempest-AttachVolumeNegativeTest-server-1329161386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1329161386',id=42,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEulkfTKE/qiZOQqcnBE34zuO175UGNFR5QPgjXSJqCVs8EIP0/YpFOBHvcoNwo4VOmyOdM0MpI2jq98duqErAUECFQywgtbI75XxqKKFwU75/RlYckrDG2/+Wcr7dILsg==',key_name='tempest-keypair-285306468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-x9pl7zbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=e7501fb9-059b-4dad-948f-6779891e0e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'pci_devices' on Instance uuid e7501fb9-059b-4dad-948f-6779891e0e58 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:55:09 user nova-compute[75648]:   <uuid>e7501fb9-059b-4dad-948f-6779891e0e58</uuid>
Nov 15 05:55:09 user nova-compute[75648]:   <name>instance-0000002a</name>
Nov 15 05:55:09 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:55:09 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:55:09 user nova-compute[75648]:   <metadata>
Nov 15 05:55:09 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:55:09 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:55:09 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1329161386</nova:name>
Nov 15 05:55:09 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:55:09</nova:creationTime>
Nov 15 05:55:09 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:55:09 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:55:09 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:55:09 user nova-compute[75648]:       <nova:owner>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:user uuid="8f995cb1428a414d91dd043e1c53d130">tempest-AttachVolumeNegativeTest-2114996187-project-member</nova:user>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:project uuid="06304608934649daab8dc8e603b9a446">tempest-AttachVolumeNegativeTest-2114996187</nova:project>
Nov 15 05:55:09 user nova-compute[75648]:       </nova:owner>
Nov 15 05:55:09 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:55:09 user nova-compute[75648]:       <nova:ports>
Nov 15 05:55:09 user nova-compute[75648]:         <nova:port uuid="0a50a2d2-525f-46dc-be05-dc1339bbd1c2">
Nov 15 05:55:09 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 05:55:09 user nova-compute[75648]:         </nova:port>
Nov 15 05:55:09 user nova-compute[75648]:       </nova:ports>
Nov 15 05:55:09 user nova-compute[75648]:     </nova:instance>
Nov 15 05:55:09 user nova-compute[75648]:   </metadata>
Nov 15 05:55:09 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:55:09 user nova-compute[75648]:     <system>
Nov 15 05:55:09 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:55:09 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:55:09 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:55:09 user nova-compute[75648]:       <entry name="serial">e7501fb9-059b-4dad-948f-6779891e0e58</entry>
Nov 15 05:55:09 user nova-compute[75648]:       <entry name="uuid">e7501fb9-059b-4dad-948f-6779891e0e58</entry>
Nov 15 05:55:09 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:55:09 user nova-compute[75648]:     </system>
Nov 15 05:55:09 user nova-compute[75648]:   </sysinfo>
Nov 15 05:55:09 user nova-compute[75648]:   <os>
Nov 15 05:55:09 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:55:09 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:55:09 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:55:09 user nova-compute[75648]:   </os>
Nov 15 05:55:09 user nova-compute[75648]:   <features>
Nov 15 05:55:09 user nova-compute[75648]:     <acpi/>
Nov 15 05:55:09 user nova-compute[75648]:     <apic/>
Nov 15 05:55:09 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:55:09 user nova-compute[75648]:   </features>
Nov 15 05:55:09 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:55:09 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:55:09 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:55:09 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:55:09 user nova-compute[75648]:   </clock>
Nov 15 05:55:09 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:55:09 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:55:09 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:55:09 user nova-compute[75648]:   </cpu>
Nov 15 05:55:09 user nova-compute[75648]:   <devices>
Nov 15 05:55:09 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:55:09 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:55:09 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk"/>
Nov 15 05:55:09 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:55:09 user nova-compute[75648]:     </disk>
Nov 15 05:55:09 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:55:09 user nova-compute[75648]:       <mac address="fa:16:3e:e8:e5:e0"/>
Nov 15 05:55:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:55:09 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:55:09 user nova-compute[75648]:       <target dev="tap0a50a2d2-52"/>
Nov 15 05:55:09 user nova-compute[75648]:     </interface>
Nov 15 05:55:09 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:55:09 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/console.log" append="off"/>
Nov 15 05:55:09 user nova-compute[75648]:     </serial>
Nov 15 05:55:09 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:55:09 user nova-compute[75648]:     <video>
Nov 15 05:55:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:55:09 user nova-compute[75648]:     </video>
Nov 15 05:55:09 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:55:09 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:55:09 user nova-compute[75648]:     </rng>
Nov 15 05:55:09 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:55:09 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:55:09 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:55:09 user nova-compute[75648]:     </memballoon>
Nov 15 05:55:09 user nova-compute[75648]:   </devices>
Nov 15 05:55:09 user nova-compute[75648]: </domain>
Nov 15 05:55:09 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1329161386',display_name='tempest-AttachVolumeNegativeTest-server-1329161386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1329161386',id=42,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEulkfTKE/qiZOQqcnBE34zuO175UGNFR5QPgjXSJqCVs8EIP0/YpFOBHvcoNwo4VOmyOdM0MpI2jq98duqErAUECFQywgtbI75XxqKKFwU75/RlYckrDG2/+Wcr7dILsg==',key_name='tempest-keypair-285306468',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-x9pl7zbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:55:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=e7501fb9-059b-4dad-948f-6779891e0e58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG os_vif [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '790ff944-ac0b-55d1-bec5-f7be0488b7ac', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a50a2d2-52, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a50a2d2-52, col_values=(('qos', UUID('4e3b2f85-0163-41ee-8477-c75b0bec4fab')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a50a2d2-52, col_values=(('external_ids', {'iface-id': '0a50a2d2-525f-46dc-be05-dc1339bbd1c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:e5:e0', 'vm-uuid': 'e7501fb9-059b-4dad-948f-6779891e0e58'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:09 user nova-compute[75648]: INFO os_vif [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52')
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:e8:e5:e0, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.neutron [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Updated VIF entry in instance network info cache for port 0a50a2d2-525f-46dc-be05-dc1339bbd1c2. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG nova.network.neutron [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Updating instance_info_cache with network_info: [{"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c9b46b29-1430-4645-b191-0530fa0735ac req-78101a2d-40b9-42cb-a05f-199df1f66265 service nova] Releasing lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-293c0fb6-2cc7-422c-b436-e98dce8f9668 req-f23bac79-9b36-4602-8bbf-51b7b2d0d6e3 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-293c0fb6-2cc7-422c-b436-e98dce8f9668 req-f23bac79-9b36-4602-8bbf-51b7b2d0d6e3 service nova] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-293c0fb6-2cc7-422c-b436-e98dce8f9668 req-f23bac79-9b36-4602-8bbf-51b7b2d0d6e3 service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-293c0fb6-2cc7-422c-b436-e98dce8f9668 req-f23bac79-9b36-4602-8bbf-51b7b2d0d6e3 service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-293c0fb6-2cc7-422c-b436-e98dce8f9668 req-f23bac79-9b36-4602-8bbf-51b7b2d0d6e3 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] No waiting events found dispatching network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:11 user nova-compute[75648]: WARNING nova.compute.manager [req-293c0fb6-2cc7-422c-b436-e98dce8f9668 req-f23bac79-9b36-4602-8bbf-51b7b2d0d6e3 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received unexpected event network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 for instance with vm_state building and task_state spawning.
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:11 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:55:11 user nova-compute[75648]: INFO nova.compute.claims [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Claim successful on node user
Nov 15 05:55:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:55:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.policy [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fdcc2d55067412ba64925df1b9ef0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb230cb5a30941d5b1901713c9082bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:55:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Creating image(s)
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk 1073741824" returned: 0 in 0.089s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-dee68736-b5fa-49e0-915b-4f94bbd01e0d req-784b2084-da03-4985-af12-6500853acd60 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dee68736-b5fa-49e0-915b-4f94bbd01e0d req-784b2084-da03-4985-af12-6500853acd60 service nova] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dee68736-b5fa-49e0-915b-4f94bbd01e0d req-784b2084-da03-4985-af12-6500853acd60 service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-dee68736-b5fa-49e0-915b-4f94bbd01e0d req-784b2084-da03-4985-af12-6500853acd60 service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-dee68736-b5fa-49e0-915b-4f94bbd01e0d req-784b2084-da03-4985-af12-6500853acd60 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] No waiting events found dispatching network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:13 user nova-compute[75648]: WARNING nova.compute.manager [req-dee68736-b5fa-49e0-915b-4f94bbd01e0d req-784b2084-da03-4985-af12-6500853acd60 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received unexpected event network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 for instance with vm_state building and task_state spawning.
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:55:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Instance spawned successfully.
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:13 user nova-compute[75648]: INFO nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Took 6.64 seconds to spawn the instance on the hypervisor.
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Cannot resize image /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Ensure instance console log exists: /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:13 user nova-compute[75648]: INFO nova.compute.manager [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Took 7.95 seconds to build instance.
Nov 15 05:55:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2539bb9b-ee19-4b77-a07e-16bcd6f92127 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "e7501fb9-059b-4dad-948f-6779891e0e58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.080s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Successfully created port: 8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Successfully updated port: 8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-changed-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Refreshing instance network info cache due to event network-changed-8420ab57-d939-403c-8051-094cc2dc2e76. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance network_info: |[{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.neutron [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Refreshing network info cache for port 8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start _get_guest_xml network_info=[{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:55:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:55:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:55:14 user nova-compute[75648]:   <uuid>8e6eb152-51f0-41a8-9d32-2b1e3831582b</uuid>
Nov 15 05:55:14 user nova-compute[75648]:   <name>instance-0000002b</name>
Nov 15 05:55:14 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:55:14 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:55:14 user nova-compute[75648]:   <metadata>
Nov 15 05:55:14 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:55:14 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:55:14 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeTestJSON-server-2058775542</nova:name>
Nov 15 05:55:14 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:55:14</nova:creationTime>
Nov 15 05:55:14 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:55:14 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:55:14 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:55:14 user nova-compute[75648]:       <nova:owner>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:user uuid="5fdcc2d55067412ba64925df1b9ef0e5">tempest-AttachVolumeTestJSON-1331007260-project-member</nova:user>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:project uuid="eb230cb5a30941d5b1901713c9082bfa">tempest-AttachVolumeTestJSON-1331007260</nova:project>
Nov 15 05:55:14 user nova-compute[75648]:       </nova:owner>
Nov 15 05:55:14 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:55:14 user nova-compute[75648]:       <nova:ports>
Nov 15 05:55:14 user nova-compute[75648]:         <nova:port uuid="8420ab57-d939-403c-8051-094cc2dc2e76">
Nov 15 05:55:14 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:55:14 user nova-compute[75648]:         </nova:port>
Nov 15 05:55:14 user nova-compute[75648]:       </nova:ports>
Nov 15 05:55:14 user nova-compute[75648]:     </nova:instance>
Nov 15 05:55:14 user nova-compute[75648]:   </metadata>
Nov 15 05:55:14 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:55:14 user nova-compute[75648]:     <system>
Nov 15 05:55:14 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:55:14 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:55:14 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:55:14 user nova-compute[75648]:       <entry name="serial">8e6eb152-51f0-41a8-9d32-2b1e3831582b</entry>
Nov 15 05:55:14 user nova-compute[75648]:       <entry name="uuid">8e6eb152-51f0-41a8-9d32-2b1e3831582b</entry>
Nov 15 05:55:14 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:55:14 user nova-compute[75648]:     </system>
Nov 15 05:55:14 user nova-compute[75648]:   </sysinfo>
Nov 15 05:55:14 user nova-compute[75648]:   <os>
Nov 15 05:55:14 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:55:14 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:55:14 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:55:14 user nova-compute[75648]:   </os>
Nov 15 05:55:14 user nova-compute[75648]:   <features>
Nov 15 05:55:14 user nova-compute[75648]:     <acpi/>
Nov 15 05:55:14 user nova-compute[75648]:     <apic/>
Nov 15 05:55:14 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:55:14 user nova-compute[75648]:   </features>
Nov 15 05:55:14 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:55:14 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:55:14 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:55:14 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:55:14 user nova-compute[75648]:   </clock>
Nov 15 05:55:14 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:55:14 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:55:14 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:55:14 user nova-compute[75648]:   </cpu>
Nov 15 05:55:14 user nova-compute[75648]:   <devices>
Nov 15 05:55:14 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:55:14 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:55:14 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk"/>
Nov 15 05:55:14 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:55:14 user nova-compute[75648]:     </disk>
Nov 15 05:55:14 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:55:14 user nova-compute[75648]:       <mac address="fa:16:3e:09:b5:d1"/>
Nov 15 05:55:14 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:55:14 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:55:14 user nova-compute[75648]:       <target dev="tap8420ab57-d9"/>
Nov 15 05:55:14 user nova-compute[75648]:     </interface>
Nov 15 05:55:14 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:55:14 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/console.log" append="off"/>
Nov 15 05:55:14 user nova-compute[75648]:     </serial>
Nov 15 05:55:14 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:55:14 user nova-compute[75648]:     <video>
Nov 15 05:55:14 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:55:14 user nova-compute[75648]:     </video>
Nov 15 05:55:14 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:55:14 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:55:14 user nova-compute[75648]:     </rng>
Nov 15 05:55:14 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:55:14 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:55:14 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:55:14 user nova-compute[75648]:     </memballoon>
Nov 15 05:55:14 user nova-compute[75648]:   </devices>
Nov 15 05:55:14 user nova-compute[75648]: </domain>
Nov 15 05:55:14 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:55:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG os_vif [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a358a64-3f7f-5431-9a1a-990000365f49', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8420ab57-d9, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8420ab57-d9, col_values=(('qos', UUID('49426b5e-d4de-4e59-84e5-2de366c13076')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8420ab57-d9, col_values=(('external_ids', {'iface-id': '8420ab57-d939-403c-8051-094cc2dc2e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:b5:d1', 'vm-uuid': '8e6eb152-51f0-41a8-9d32-2b1e3831582b'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:14 user nova-compute[75648]: INFO os_vif [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9')
Nov 15 05:55:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:55:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No VIF found with MAC fa:16:3e:09:b5:d1, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:55:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updated VIF entry in instance network info cache for port 8420ab57-d939-403c-8051-094cc2dc2e76. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:55:15 user nova-compute[75648]: DEBUG nova.network.neutron [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9324d956-4d67-4d63-ae34-1eed16398409 req-44a0bed8-ead5-42de-88de-3ac5b0c9a063 service nova] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-7fc7d331-cacc-4bb1-8c6b-d96a2cc5e85e req-2ca9ac3b-9043-4aa0-96b6-61c68356beff service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7fc7d331-cacc-4bb1-8c6b-d96a2cc5e85e req-2ca9ac3b-9043-4aa0-96b6-61c68356beff service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7fc7d331-cacc-4bb1-8c6b-d96a2cc5e85e req-2ca9ac3b-9043-4aa0-96b6-61c68356beff service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7fc7d331-cacc-4bb1-8c6b-d96a2cc5e85e req-2ca9ac3b-9043-4aa0-96b6-61c68356beff service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-7fc7d331-cacc-4bb1-8c6b-d96a2cc5e85e req-2ca9ac3b-9043-4aa0-96b6-61c68356beff service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:16 user nova-compute[75648]: WARNING nova.compute.manager [req-7fc7d331-cacc-4bb1-8c6b-d96a2cc5e85e req-2ca9ac3b-9043-4aa0-96b6-61c68356beff service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state building and task_state spawning.
Nov 15 05:55:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:55:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance spawned successfully.
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-54b00db4-e61c-45d9-9187-57f736aad210 req-3df594c6-cfd1-47b4-8594-e5b8132da8ed service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-54b00db4-e61c-45d9-9187-57f736aad210 req-3df594c6-cfd1-47b4-8594-e5b8132da8ed service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-54b00db4-e61c-45d9-9187-57f736aad210 req-3df594c6-cfd1-47b4-8594-e5b8132da8ed service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-54b00db4-e61c-45d9-9187-57f736aad210 req-3df594c6-cfd1-47b4-8594-e5b8132da8ed service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-54b00db4-e61c-45d9-9187-57f736aad210 req-3df594c6-cfd1-47b4-8594-e5b8132da8ed service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:18 user nova-compute[75648]: WARNING nova.compute.manager [req-54b00db4-e61c-45d9-9187-57f736aad210 req-3df594c6-cfd1-47b4-8594-e5b8132da8ed service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state building and task_state spawning.
Nov 15 05:55:18 user nova-compute[75648]: INFO nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Took 6.48 seconds to spawn the instance on the hypervisor.
Nov 15 05:55:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:55:19 user nova-compute[75648]: INFO nova.compute.manager [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Took 7.39 seconds to build instance.
Nov 15 05:55:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ac84e8c3-cb48-4700-a895-fe1952beea71 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.497s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_power_states {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid f66dc876-aae4-4e20-8b96-c47a8e3dff60 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 94a41326-1559-42e7-a95f-9e86259b26ef {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid b955533a-d29e-4a8f-9c8e-7da7ae052eae {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 84676ebd-9adb-45fb-8efb-55079478860b {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid e7501fb9-059b-4dad-948f-6779891e0e58 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "94a41326-1559-42e7-a95f-9e86259b26ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "64004f1c-2f3f-4d02-8632-823a13493b17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "cfba25df-06bc-4064-a681-e39c39bff579" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "84676ebd-9adb-45fb-8efb-55079478860b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "e7501fb9-059b-4dad-948f-6779891e0e58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "94a41326-1559-42e7-a95f-9e86259b26ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.060s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "64004f1c-2f3f-4d02-8632-823a13493b17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "cfba25df-06bc-4064-a681-e39c39bff579" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.066s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "84676ebd-9adb-45fb-8efb-55079478860b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.098s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "e7501fb9-059b-4dad-948f-6779891e0e58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.107s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-changed-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Refreshing instance network info cache due to event network-changed-54c2ffb3-5d68-4609-9627-2a39d6013261. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:55:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] Acquiring lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] Acquired lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:32 user nova-compute[75648]: DEBUG nova.network.neutron [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Refreshing network info cache for port 54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updated VIF entry in instance network info cache for port 54c2ffb3-5d68-4609-9627-2a39d6013261. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updating instance_info_cache with network_info: [{"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3cf8daf7-8f19-4495-ace4-30892ad9cba6 req-f731d7d8-be88-4a89-bdf7-f09dea0f26ea service nova] Releasing lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-changed-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Refreshing instance network info cache due to event network-changed-54c2ffb3-5d68-4609-9627-2a39d6013261. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] Acquiring lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] Acquired lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:33 user nova-compute[75648]: DEBUG nova.network.neutron [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Refreshing network info cache for port 54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "84676ebd-9adb-45fb-8efb-55079478860b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:34 user nova-compute[75648]: INFO nova.compute.manager [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Terminating instance
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updated VIF entry in instance network info cache for port 54c2ffb3-5d68-4609-9627-2a39d6013261. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updating instance_info_cache with network_info: [{"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f2af162b-8142-4a02-9827-ac7f73c843fc req-71f78bef-3857-480b-b573-a93943d48e75 service nova] Releasing lock "refresh_cache-84676ebd-9adb-45fb-8efb-55079478860b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-vif-unplugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] No waiting events found dispatching network-vif-unplugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-vif-unplugged-54c2ffb3-5d68-4609-9627-2a39d6013261 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] Acquiring lock "84676ebd-9adb-45fb-8efb-55079478860b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] Lock "84676ebd-9adb-45fb-8efb-55079478860b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] No waiting events found dispatching network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:34 user nova-compute[75648]: WARNING nova.compute.manager [req-66d0b181-3b29-494f-81cf-a15f46239c83 req-44f14ab2-2743-4bcc-9807-3dcc2918ae90 service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received unexpected event network-vif-plugged-54c2ffb3-5d68-4609-9627-2a39d6013261 for instance with vm_state active and task_state deleting.
Nov 15 05:55:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Instance destroyed successfully.
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'resources' on Instance uuid 84676ebd-9adb-45fb-8efb-55079478860b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:53:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-734886916',display_name='tempest-TestVolumeBootPattern-server-734886916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-734886916',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:53:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-iqi5hqhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:53:53Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=84676ebd-9adb-45fb-8efb-55079478860b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "54c2ffb3-5d68-4609-9627-2a39d6013261", "address": "fa:16:3e:fe:88:f1", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54c2ffb3-5d", "ovs_interfaceid": "54c2ffb3-5d68-4609-9627-2a39d6013261", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_vif [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54c2ffb3-5d, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bda833e0-9b18-40ac-8ef5-4f0911790ea6) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:34 user nova-compute[75648]: INFO os_vif [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:88:f1,bridge_name='br-int',has_traffic_filtering=True,id=54c2ffb3-5d68-4609-9627-2a39d6013261,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54c2ffb3-5d')
Nov 15 05:55:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aIuJFhdp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:55:34 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a00cc3-0b8d-4105-ad38-db0c59895fb7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:55:34 user nova-compute[75648]: No targets found.
Nov 15 05:55:34 user nova-compute[75648]: iSNS:
Nov 15 05:55:34 user nova-compute[75648]: No targets found.
Nov 15 05:55:34 user nova-compute[75648]: STATIC:
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e
Nov 15 05:55:34 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:55:34 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:55:34 user nova-compute[75648]: FIRMWARE:
Nov 15 05:55:34 user nova-compute[75648]: No targets found.
Nov 15 05:55:34 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:55:34 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:55:34 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b7bbb-4cb9-404f-a968-0c45b745f185]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dedfac-06e4-403d-b514-30270ca782eb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:55:34 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:55:34 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:55:34 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e858a560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64f48bb-f293-46f7-ad2e-dd93910b0d5e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4bcd63-c806-48b4-b49a-177a8619bb67]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f3c3ad-7512-47af-92b9-169a51c7c709]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[186d59ab-6949-4c9d-821c-29e6dcdd166f]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a018d130', '/dev/disk/by-id/scsi-23839383833646461', '/dev/disk/by-id/scsi-1SCST_BIOa018d130-89883dda39676332') {{(pid=87015) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 05:55:35 user nova-compute[75648]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a018d130
Nov 15 05:55:35 user nova-compute[75648]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23839383833646461
Nov 15 05:55:35 user nova-compute[75648]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa018d130-89883dda39676332
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc349a71-4d8a-420e-bf4e-a914137daec0]: (4, None) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f68839a-d42a-4ed7-b9e3-175419d2b88b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c60fb77-3f75-4b0d-969e-8de10f7fcbc7]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260]
Nov 15 05:55:35 user nova-compute[75648]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e, portal: 172.16.0.220,3260] successful.
Nov 15 05:55:35 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf20c0a8-4092-4fa6-a167-1d90eaa07a4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[202add70-7dd1-40fb-aaa6-da4ae264307f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.398s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== disconnect_volume: return (399ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:55:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Deleting instance files /opt/stack/data/nova/instances/84676ebd-9adb-45fb-8efb-55079478860b_del
Nov 15 05:55:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Deletion of /opt/stack/data/nova/instances/84676ebd-9adb-45fb-8efb-55079478860b_del complete
Nov 15 05:55:35 user nova-compute[75648]: INFO nova.compute.manager [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 15 05:55:35 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:55:35 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:35 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Took 0.48 seconds to deallocate network for instance.
Nov 15 05:55:36 user nova-compute[75648]: INFO nova.compute.manager [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Took 0.75 seconds to detach 1 volumes for instance.
Nov 15 05:55:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-5d612b40-8720-4c30-854f-c31d98188056 req-48b02dda-c3b0-4062-91b6-35de13906c8b service nova] [instance: 84676ebd-9adb-45fb-8efb-55079478860b] Received event network-vif-deleted-54c2ffb3-5d68-4609-9627-2a39d6013261 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:37 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:55:37 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:55:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:37 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Deleted allocations for instance 84676ebd-9adb-45fb-8efb-55079478860b
Nov 15 05:55:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a64121f0-d003-459b-9123-57b552fa7008 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "84676ebd-9adb-45fb-8efb-55079478860b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.175s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:42 user nova-compute[75648]: INFO nova.compute.manager [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Terminating instance
Nov 15 05:55:42 user nova-compute[75648]: DEBUG nova.compute.manager [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Instance destroyed successfully.
Nov 15 05:55:42 user nova-compute[75648]: DEBUG nova.objects.instance [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lazy-loading 'resources' on Instance uuid c6859cea-129c-472b-aba0-b609ddc5f89a {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-618512900',display_name='tempest-ServerRescueNegativeTestJSON-server-618512900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-618512900',id=1,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ba132e2da344b8da008767a69ba0f3f',ramdisk_id='',reservation_id='r-e00zqohb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1116175393',owner_user_name='tempest-ServerRescueNegativeTestJSON-1116175393-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:32Z,user_data=None,user_id='e20600cd4fd148b1b871195e1e5397d7',uuid=c6859cea-129c-472b-aba0-b609ddc5f89a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converting VIF {"id": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "address": "fa:16:3e:6a:e8:00", "network": {"id": "8d26b871-d5df-44e1-8dfc-cc38cd5c7e11", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2121786265-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ba132e2da344b8da008767a69ba0f3f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap563c8454-c7", "ovs_interfaceid": "563c8454-c7b5-4d8f-9c22-a8da90b69a3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG os_vif [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap563c8454-c7, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0965ebeb-bf3c-48eb-8dc4-eb7c5a49ce0d) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:42 user nova-compute[75648]: INFO os_vif [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:e8:00,bridge_name='br-int',has_traffic_filtering=True,id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a,network=Network(8d26b871-d5df-44e1-8dfc-cc38cd5c7e11),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap563c8454-c7')
Nov 15 05:55:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Deleting instance files /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a_del
Nov 15 05:55:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Deletion of /opt/stack/data/nova/instances/c6859cea-129c-472b-aba0-b609ddc5f89a_del complete
Nov 15 05:55:43 user nova-compute[75648]: INFO nova.compute.manager [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 15 05:55:43 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:43 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Took 0.48 seconds to deallocate network for instance.
Nov 15 05:55:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-87392f99-7c14-41ec-bde8-78d624a2bd3d req-385add3a-5172-4ef9-ae91-9b9f11d5d0ca service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Received event network-vif-deleted-563c8454-c7b5-4d8f-9c22-a8da90b69a3a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:43 user nova-compute[75648]: INFO nova.compute.manager [req-87392f99-7c14-41ec-bde8-78d624a2bd3d req-385add3a-5172-4ef9-ae91-9b9f11d5d0ca service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Neutron deleted interface 563c8454-c7b5-4d8f-9c22-a8da90b69a3a; detaching it from the instance and deleting it from the info cache
Nov 15 05:55:43 user nova-compute[75648]: DEBUG nova.network.neutron [req-87392f99-7c14-41ec-bde8-78d624a2bd3d req-385add3a-5172-4ef9-ae91-9b9f11d5d0ca service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-87392f99-7c14-41ec-bde8-78d624a2bd3d req-385add3a-5172-4ef9-ae91-9b9f11d5d0ca service nova] [instance: c6859cea-129c-472b-aba0-b609ddc5f89a] Detach interface failed, port_id=563c8454-c7b5-4d8f-9c22-a8da90b69a3a, reason: Instance c6859cea-129c-472b-aba0-b609ddc5f89a could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:44 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:55:44 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:55:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:44 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Deleted allocations for instance c6859cea-129c-472b-aba0-b609ddc5f89a
Nov 15 05:55:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-30da7eab-d44c-4ea3-8c66-e1bf89313642 tempest-ServerRescueNegativeTestJSON-1116175393 tempest-ServerRescueNegativeTestJSON-1116175393-project-member] Lock "c6859cea-129c-472b-aba0-b609ddc5f89a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:55:45 user nova-compute[75648]: INFO nova.compute.claims [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Claim successful on node user
Nov 15 05:55:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.447s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:55:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:55:45 user nova-compute[75648]: DEBUG nova.policy [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ae6fbc67c6147f6bb3dcf77e5426374', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd36638b70b3408e89a1f04557ff9324', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:55:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Creating image(s)
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "/opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "/opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "/opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk 1073741824" returned: 0 in 0.049s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Successfully created port: 4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Cannot resize image /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Ensure instance console log exists: /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Successfully updated port: 4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquired lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-changed-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.compute.manager [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Refreshing instance network info cache due to event network-changed-4b5abff5-290e-466d-8fb6-a7fe513056cd. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] Acquiring lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.network.neutron [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating instance_info_cache with network_info: [{"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Releasing lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Instance network_info: |[{"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] Acquired lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.network.neutron [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Refreshing network info cache for port 4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Start _get_guest_xml network_info=[{"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:47 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:47 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:55:47 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1812702776',display_name='tempest-SnapshotDataIntegrityTests-server-1812702776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1812702776',id=44,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsYf5j0XOt1m0HaO+58/YL85UALjSjTVu947ridnaizjlccoHwgJGpt+gCdEKdsFG57ezeKdybOz2uQLB753JuNI+ReX9XPvy2OwcTKILTvfrPioSwTUqdEtrojYo4t5g==',key_name='tempest-keypair-1421163534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd36638b70b3408e89a1f04557ff9324',ramdisk_id='',reservation_id='r-hpze54vb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-855355549',owner_user_name='tempest-SnapshotDataIntegrityTests-855355549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6fbc67c6147f6bb3dcf77e5426374',uuid=e21dec3d-4aa8-4066-99c8-2782c41f913e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Converting VIF {"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'pci_devices' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:55:48 user nova-compute[75648]:   <uuid>e21dec3d-4aa8-4066-99c8-2782c41f913e</uuid>
Nov 15 05:55:48 user nova-compute[75648]:   <name>instance-0000002c</name>
Nov 15 05:55:48 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:55:48 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:55:48 user nova-compute[75648]:   <metadata>
Nov 15 05:55:48 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:55:48 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:55:48 user nova-compute[75648]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1812702776</nova:name>
Nov 15 05:55:48 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:55:47</nova:creationTime>
Nov 15 05:55:48 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:55:48 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:55:48 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:55:48 user nova-compute[75648]:       <nova:owner>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:user uuid="0ae6fbc67c6147f6bb3dcf77e5426374">tempest-SnapshotDataIntegrityTests-855355549-project-member</nova:user>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:project uuid="dd36638b70b3408e89a1f04557ff9324">tempest-SnapshotDataIntegrityTests-855355549</nova:project>
Nov 15 05:55:48 user nova-compute[75648]:       </nova:owner>
Nov 15 05:55:48 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:55:48 user nova-compute[75648]:       <nova:ports>
Nov 15 05:55:48 user nova-compute[75648]:         <nova:port uuid="4b5abff5-290e-466d-8fb6-a7fe513056cd">
Nov 15 05:55:48 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 15 05:55:48 user nova-compute[75648]:         </nova:port>
Nov 15 05:55:48 user nova-compute[75648]:       </nova:ports>
Nov 15 05:55:48 user nova-compute[75648]:     </nova:instance>
Nov 15 05:55:48 user nova-compute[75648]:   </metadata>
Nov 15 05:55:48 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:55:48 user nova-compute[75648]:     <system>
Nov 15 05:55:48 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:55:48 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:55:48 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:55:48 user nova-compute[75648]:       <entry name="serial">e21dec3d-4aa8-4066-99c8-2782c41f913e</entry>
Nov 15 05:55:48 user nova-compute[75648]:       <entry name="uuid">e21dec3d-4aa8-4066-99c8-2782c41f913e</entry>
Nov 15 05:55:48 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:55:48 user nova-compute[75648]:     </system>
Nov 15 05:55:48 user nova-compute[75648]:   </sysinfo>
Nov 15 05:55:48 user nova-compute[75648]:   <os>
Nov 15 05:55:48 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:55:48 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:55:48 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:55:48 user nova-compute[75648]:   </os>
Nov 15 05:55:48 user nova-compute[75648]:   <features>
Nov 15 05:55:48 user nova-compute[75648]:     <acpi/>
Nov 15 05:55:48 user nova-compute[75648]:     <apic/>
Nov 15 05:55:48 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:55:48 user nova-compute[75648]:   </features>
Nov 15 05:55:48 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:55:48 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:55:48 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:55:48 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:55:48 user nova-compute[75648]:   </clock>
Nov 15 05:55:48 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:55:48 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:55:48 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:55:48 user nova-compute[75648]:   </cpu>
Nov 15 05:55:48 user nova-compute[75648]:   <devices>
Nov 15 05:55:48 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:55:48 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:55:48 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk"/>
Nov 15 05:55:48 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:55:48 user nova-compute[75648]:     </disk>
Nov 15 05:55:48 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:55:48 user nova-compute[75648]:       <mac address="fa:16:3e:09:c2:02"/>
Nov 15 05:55:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:55:48 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:55:48 user nova-compute[75648]:       <target dev="tap4b5abff5-29"/>
Nov 15 05:55:48 user nova-compute[75648]:     </interface>
Nov 15 05:55:48 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:55:48 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/console.log" append="off"/>
Nov 15 05:55:48 user nova-compute[75648]:     </serial>
Nov 15 05:55:48 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:55:48 user nova-compute[75648]:     <video>
Nov 15 05:55:48 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:55:48 user nova-compute[75648]:     </video>
Nov 15 05:55:48 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:55:48 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:55:48 user nova-compute[75648]:     </rng>
Nov 15 05:55:48 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:55:48 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:55:48 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:55:48 user nova-compute[75648]:     </memballoon>
Nov 15 05:55:48 user nova-compute[75648]:   </devices>
Nov 15 05:55:48 user nova-compute[75648]: </domain>
Nov 15 05:55:48 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1812702776',display_name='tempest-SnapshotDataIntegrityTests-server-1812702776',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1812702776',id=44,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsYf5j0XOt1m0HaO+58/YL85UALjSjTVu947ridnaizjlccoHwgJGpt+gCdEKdsFG57ezeKdybOz2uQLB753JuNI+ReX9XPvy2OwcTKILTvfrPioSwTUqdEtrojYo4t5g==',key_name='tempest-keypair-1421163534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd36638b70b3408e89a1f04557ff9324',ramdisk_id='',reservation_id='r-hpze54vb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-855355549',owner_user_name='tempest-SnapshotDataIntegrityTests-855355549-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6fbc67c6147f6bb3dcf77e5426374',uuid=e21dec3d-4aa8-4066-99c8-2782c41f913e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Converting VIF {"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG os_vif [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dc529b1-3526-54f9-a069-5fe1e6faa8d9', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4b5abff5-29, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4b5abff5-29, col_values=(('qos', UUID('5a3d9d36-8d1e-4f97-825b-f5ff715f741a')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4b5abff5-29, col_values=(('external_ids', {'iface-id': '4b5abff5-290e-466d-8fb6-a7fe513056cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:c2:02', 'vm-uuid': 'e21dec3d-4aa8-4066-99c8-2782c41f913e'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: INFO os_vif [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29')
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No VIF found with MAC fa:16:3e:09:c2:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.network.neutron [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updated VIF entry in instance network info cache for port 4b5abff5-290e-466d-8fb6-a7fe513056cd. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG nova.network.neutron [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating instance_info_cache with network_info: [{"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:55:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2acd43e8-b751-456e-96ff-bfc3bf9ffa15 req-15927499-3c2f-4b4f-921e-fc99a6d50d33 service nova] Releasing lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-8c6f2d5d-6ba1-4cd3-ace1-f260a083107b req-ddf14a26-34e3-4849-9efb-b633d7113ffd service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8c6f2d5d-6ba1-4cd3-ace1-f260a083107b req-ddf14a26-34e3-4849-9efb-b633d7113ffd service nova] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8c6f2d5d-6ba1-4cd3-ace1-f260a083107b req-ddf14a26-34e3-4849-9efb-b633d7113ffd service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8c6f2d5d-6ba1-4cd3-ace1-f260a083107b req-ddf14a26-34e3-4849-9efb-b633d7113ffd service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-8c6f2d5d-6ba1-4cd3-ace1-f260a083107b req-ddf14a26-34e3-4849-9efb-b633d7113ffd service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] No waiting events found dispatching network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:49 user nova-compute[75648]: WARNING nova.compute.manager [req-8c6f2d5d-6ba1-4cd3-ace1-f260a083107b req-ddf14a26-34e3-4849-9efb-b633d7113ffd service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received unexpected event network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd for instance with vm_state building and task_state spawning.
Nov 15 05:55:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:55:51 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Instance spawned successfully.
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-756445ed-eae1-421a-b10f-43e9d89f9e5e req-a17b8286-ae6c-49b3-a909-b67435211ba9 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-756445ed-eae1-421a-b10f-43e9d89f9e5e req-a17b8286-ae6c-49b3-a909-b67435211ba9 service nova] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-756445ed-eae1-421a-b10f-43e9d89f9e5e req-a17b8286-ae6c-49b3-a909-b67435211ba9 service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-756445ed-eae1-421a-b10f-43e9d89f9e5e req-a17b8286-ae6c-49b3-a909-b67435211ba9 service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.compute.manager [req-756445ed-eae1-421a-b10f-43e9d89f9e5e req-a17b8286-ae6c-49b3-a909-b67435211ba9 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] No waiting events found dispatching network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:55:51 user nova-compute[75648]: WARNING nova.compute.manager [req-756445ed-eae1-421a-b10f-43e9d89f9e5e req-a17b8286-ae6c-49b3-a909-b67435211ba9 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received unexpected event network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd for instance with vm_state building and task_state spawning.
Nov 15 05:55:51 user nova-compute[75648]: INFO nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 15 05:55:51 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:55:51 user nova-compute[75648]: INFO nova.compute.manager [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Took 6.58 seconds to build instance.
Nov 15 05:55:51 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1c720d59-61d2-4f35-9f7b-8c37beebd286 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.688s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:55:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:55:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:56 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:55:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:56:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:56:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:56:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:56:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:56:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7295MB free_disk=24.935508728027344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 64004f1c-2f3f-4d02-8632-823a13493b17 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cfba25df-06bc-4064-a681-e39c39bff579 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fdf4097a-b7f0-4802-8abc-2583acd8ab84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e7501fb9-059b-4dad-948f-6779891e0e58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e21dec3d-4aa8-4066-99c8-2782c41f913e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.505s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:56:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:27 user nova-compute[75648]: DEBUG nova.compute.manager [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing instance network info cache due to event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:56:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:56:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:56:27 user nova-compute[75648]: DEBUG nova.network.neutron [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updated VIF entry in instance network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG nova.network.neutron [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-bdfad0ab-2a04-46c1-935a-cc30285a2189 req-db2309a5-3322-42f3-baf3-fa383e8d8100 service nova] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:28 user nova-compute[75648]: INFO nova.compute.manager [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Shelve offloading
Nov 15 05:56:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-01b8e353-451d-4db4-b6b5-95ebcec07a5b req-2ebad0dc-4404-462b-b8e3-28929b8f0643 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-unplugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-01b8e353-451d-4db4-b6b5-95ebcec07a5b req-2ebad0dc-4404-462b-b8e3-28929b8f0643 service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-01b8e353-451d-4db4-b6b5-95ebcec07a5b req-2ebad0dc-4404-462b-b8e3-28929b8f0643 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-01b8e353-451d-4db4-b6b5-95ebcec07a5b req-2ebad0dc-4404-462b-b8e3-28929b8f0643 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-01b8e353-451d-4db4-b6b5-95ebcec07a5b req-2ebad0dc-4404-462b-b8e3-28929b8f0643 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-unplugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:28 user nova-compute[75648]: WARNING nova.compute.manager [req-01b8e353-451d-4db4-b6b5-95ebcec07a5b req-2ebad0dc-4404-462b-b8e3-28929b8f0643 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-unplugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state active and task_state shelving.
Nov 15 05:56:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance destroyed successfully.
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.network.neutron [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:29 user nova-compute[75648]: INFO nova.compute.manager [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Terminating instance
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance destroyed successfully.
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'resources' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1341763353',display_name='tempest-TestShelveInstance-server-1341763353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1341763353',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq2HhlG5b9x0nJmzt8cepOedKjawpG0QLkzmrdDlBep6Zc8jxWnSTc5rjLZuhnzrpPjTv2R+//hXw0zmXOJ388Xh8J0UmhI83aCpX0khAF+L+9zAZSkhoniuwIXfVD08A==',key_name='tempest-TestShelveInstance-1044638316',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb07fa691bf94a7f8a85cd8edf71b795',ramdisk_id='',reservation_id='r-2r401zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-812316993',owner_user_name='tempest-TestShelveInstance-812316993-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:54:47Z,user_data=None,user_id='eb4b0c67e9cd4a3eb697f4d2b1668fb6',uuid=fdf4097a-b7f0-4802-8abc-2583acd8ab84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converting VIF {"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG os_vif [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9de3a7e3-31, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.compute.manager [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing instance network info cache due to event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG nova.network.neutron [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=574a8c9b-f549-4637-91d6-ed9f0d2ca2f8) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:30 user nova-compute[75648]: INFO os_vif [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31')
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:56:30 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-ee5f7fb3-3727-4032-9dd0-87042a763963 req-7c6e573c-e617-4f9d-acf2-c0351f5f4163 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-vif-unplugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ee5f7fb3-3727-4032-9dd0-87042a763963 req-7c6e573c-e617-4f9d-acf2-c0351f5f4163 service nova] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ee5f7fb3-3727-4032-9dd0-87042a763963 req-7c6e573c-e617-4f9d-acf2-c0351f5f4163 service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ee5f7fb3-3727-4032-9dd0-87042a763963 req-7c6e573c-e617-4f9d-acf2-c0351f5f4163 service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-ee5f7fb3-3727-4032-9dd0-87042a763963 req-7c6e573c-e617-4f9d-acf2-c0351f5f4163 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] No waiting events found dispatching network-vif-unplugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-ee5f7fb3-3727-4032-9dd0-87042a763963 req-7c6e573c-e617-4f9d-acf2-c0351f5f4163 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-vif-unplugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc94d63c-8ab5-4537-9118-d8747c8ce6e7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:56:30 user nova-compute[75648]: No targets found.
Nov 15 05:56:30 user nova-compute[75648]: iSNS:
Nov 15 05:56:30 user nova-compute[75648]: No targets found.
Nov 15 05:56:30 user nova-compute[75648]: STATIC:
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: FIRMWARE:
Nov 15 05:56:30 user nova-compute[75648]: No targets found.
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:56:30 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:56:30 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a1d1f8-dd37-4332-b585-2f443ca7d2b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4807fa28-cda2-4ddb-be5e-7d4d16b4cb53]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47cce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715'): ({'sdh'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Removing single pathed devices sdh {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f118a066-e513-4d4a-9ac1-483685dfc3da]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[440e903b-e415-4033-a1ab-6187e0c909cd]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Flushing IO for device /dev/sdh {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154197f-b7ea-4a27-9c79-6e686b896fea]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcbfe4c-0476-432f-ba3b-75df08e30a1b]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] SCSI volumes sdh have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84b9a48-f703-4743-9a14-718d7cb5699d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8378d35f-7043-465d-9ac5-a88c77c05428]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]
Nov 15 05:56:30 user nova-compute[75648]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1312a286-2221-4efd-adb2-0ff7cc8ff733]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] <== disconnect_volume: return (348ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:56:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Deleting instance files /opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84_del
Nov 15 05:56:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Deletion of /opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84_del complete
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updated VIF entry in instance network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": null, "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c0d07adc-f7f7-4b47-bf77-1b02b7371ae5 req-39b0b8d4-5c5c-4582-b941-2e2328715f58 service nova] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:56:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Instance destroyed successfully.
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lazy-loading 'resources' on Instance uuid 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-220797488',display_name='tempest-TestVolumeBootPattern-server-220797488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-220797488',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzQEK9wotzFgjamFMl0Ih0Iilt29uhX4O8zOgmJdWtZbMTt2sx7K6KErrrMOlvsFsdWKKoByjxLG5vBqc+TW8OsryroYz2tUaOve9P744XQz2oGVDBRJAIPSQL0wXIJ9A==',key_name='tempest-TestVolumeBootPattern-644865755',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:51:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bea832b577b9445782f27e28b1023e96',ramdisk_id='',reservation_id='r-vqu9qsll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-522670763',owner_user_name='tempest-TestVolumeBootPattern-522670763-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:51:56Z,user_data=None,user_id='2fd4a8513df14fc7ab09905d24220ae1',uuid=0ceb02d8-10d9-41f3-ba03-aa12de0d3d53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converting VIF {"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_vif [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83f94d30-60, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2342acc7-3bae-4563-ad29-49e6cb0612cc) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:30 user nova-compute[75648]: INFO os_vif [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:86:ba,bridge_name='br-int',has_traffic_filtering=True,id=83f94d30-6074-487a-a9b2-8bf156cfdc70,network=Network(24daf950-61d1-435e-a8bc-96e3d1044228),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83f94d30-60')
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DcAkOBHq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:56:30 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5ceab-bbf5-4748-b966-b5438f2c62aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:56:30 user nova-compute[75648]: No targets found.
Nov 15 05:56:30 user nova-compute[75648]: iSNS:
Nov 15 05:56:30 user nova-compute[75648]: No targets found.
Nov 15 05:56:30 user nova-compute[75648]: STATIC:
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:56:30 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:30 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:30 user nova-compute[75648]: FIRMWARE:
Nov 15 05:56:30 user nova-compute[75648]: No targets found.
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:56:30 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:56:30 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85e85dc-5a18-48fc-91e5-1cc673a68613]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb411ca-7d91-4a6f-bfda-b49f10f2d4e4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:56:30 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e86b6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa'): ({'sdg'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Removing single pathed devices sdg {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce0db1f9-17d8-4737-bdaa-2132276db504]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:30 user nova-compute[75648]: WARNING nova.compute.manager [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state active and task_state shelving.
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-changed-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Refreshing instance network info cache due to event network-changed-83f94d30-6074-487a-a9b2-8bf156cfdc70. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] Acquiring lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] Acquired lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Refreshing network info cache for port 83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[87992e6c-32cf-43ed-9c95-753c31c808b7]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Flushing IO for device /dev/sdg {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[37734026-6160-4c59-8afd-e4b3026c1e69]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc224b2f-ba3f-43e4-b1b0-dc5f06df231c]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] SCSI volumes sdg have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb28972e-e20b-4844-9264-46942514d963]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e78adc-b8e4-4b2a-8105-de4b488449e8]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260]
Nov 15 05:56:30 user nova-compute[75648]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa, portal: 172.16.0.220,3260] successful.
Nov 15 05:56:30 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82037273-a7aa-4a6e-870e-4e53bbd209fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c057854-6463-4109-be27-f889ea0a122b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] <== disconnect_volume: return (324ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:56:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Deleting instance files /opt/stack/data/nova/instances/0ceb02d8-10d9-41f3-ba03-aa12de0d3d53_del
Nov 15 05:56:30 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Deletion of /opt/stack/data/nova/instances/0ceb02d8-10d9-41f3-ba03-aa12de0d3d53_del complete
Nov 15 05:56:30 user nova-compute[75648]: INFO nova.compute.manager [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 15 05:56:30 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updated VIF entry in instance network info cache for port 83f94d30-6074-487a-a9b2-8bf156cfdc70. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:56:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updating instance_info_cache with network_info: [{"id": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "address": "fa:16:3e:60:86:ba", "network": {"id": "24daf950-61d1-435e-a8bc-96e3d1044228", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-518363465-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bea832b577b9445782f27e28b1023e96", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83f94d30-60", "ovs_interfaceid": "83f94d30-6074-487a-a9b2-8bf156cfdc70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e314c871-9399-4dc3-852b-2d1033a29df6 req-f2719d25-de8b-450c-adc5-d44346205138 service nova] Releasing lock "refresh_cache-0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:31 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Took 0.39 seconds to deallocate network for instance.
Nov 15 05:56:31 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Deleted allocations for instance fdf4097a-b7f0-4802-8abc-2583acd8ab84
Nov 15 05:56:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'numa_topology' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG nova.objects.base [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Object Instance<fdf4097a-b7f0-4802-8abc-2583acd8ab84> lazy-loaded attributes: resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.337s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ccccf5a9-1e0e-499a-b7db-1f28af73d4eb tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.673s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:32 user nova-compute[75648]: INFO nova.compute.manager [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] Acquiring lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] No waiting events found dispatching network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:32 user nova-compute[75648]: WARNING nova.compute.manager [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received unexpected event network-vif-plugged-83f94d30-6074-487a-a9b2-8bf156cfdc70 for instance with vm_state deleted and task_state None.
Nov 15 05:56:32 user nova-compute[75648]: DEBUG nova.compute.manager [req-37e8a936-fa95-45e5-9c28-dabd04bf21f3 req-913feb75-7f9e-4998-b174-32a2a23d6bc4 service nova] [instance: 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53] Received event network-vif-deleted-83f94d30-6074-487a-a9b2-8bf156cfdc70 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:32 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Deleted allocations for instance 0ceb02d8-10d9-41f3-ba03-aa12de0d3d53
Nov 15 05:56:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b7e2191e-cfc1-4080-97be-0218a1e38c74 tempest-TestVolumeBootPattern-522670763 tempest-TestVolumeBootPattern-522670763-project-member] Lock "0ceb02d8-10d9-41f3-ba03-aa12de0d3d53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.878s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "64004f1c-2f3f-4d02-8632-823a13493b17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:46 user nova-compute[75648]: INFO nova.compute.manager [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Terminating instance
Nov 15 05:56:46 user nova-compute[75648]: DEBUG nova.compute.manager [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-73188c0a-fe69-458c-ac91-54d52ad3a495 req-1636ab74-5125-4d82-982a-e71ca955093d service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-73188c0a-fe69-458c-ac91-54d52ad3a495 req-1636ab74-5125-4d82-982a-e71ca955093d service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-73188c0a-fe69-458c-ac91-54d52ad3a495 req-1636ab74-5125-4d82-982a-e71ca955093d service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-73188c0a-fe69-458c-ac91-54d52ad3a495 req-1636ab74-5125-4d82-982a-e71ca955093d service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-73188c0a-fe69-458c-ac91-54d52ad3a495 req-1636ab74-5125-4d82-982a-e71ca955093d service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG nova.compute.manager [req-73188c0a-fe69-458c-ac91-54d52ad3a495 req-1636ab74-5125-4d82-982a-e71ca955093d service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-unplugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Instance destroyed successfully.
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.objects.instance [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'resources' on Instance uuid 64004f1c-2f3f-4d02-8632-823a13493b17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:51:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1854119887',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1854119887',id=36,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:53:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-4s3zb3l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:55:00Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=64004f1c-2f3f-4d02-8632-823a13493b17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "address": "fa:16:3e:e9:99:2a", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ef8671-4b", "ovs_interfaceid": "a6ef8671-4b2e-4715-a58c-ebc9ea360446", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_vif [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6ef8671-4b, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b2cc31d-edf4-4683-bcd3-6990d68b4995) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:47 user nova-compute[75648]: INFO os_vif [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:99:2a,bridge_name='br-int',has_traffic_filtering=True,id=a6ef8671-4b2e-4715-a58c-ebc9ea360446,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ef8671-4b')
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lrFTqEYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:56:47 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5db8087-648d-4210-bd25-eb35bacc29fa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:56:47 user nova-compute[75648]: No targets found.
Nov 15 05:56:47 user nova-compute[75648]: iSNS:
Nov 15 05:56:47 user nova-compute[75648]: No targets found.
Nov 15 05:56:47 user nova-compute[75648]: STATIC:
Nov 15 05:56:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:56:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:56:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f
Nov 15 05:56:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:47 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:56:47 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:56:47 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:56:47 user nova-compute[75648]: FIRMWARE:
Nov 15 05:56:47 user nova-compute[75648]: No targets found.
Nov 15 05:56:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:56:47 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:56:47 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c2dc8b-cdb9-4a40-85a4-b56f9598cb5a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a501ab7c-4e6a-4f79-a099-b3c6da08bee6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:56:47 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:56:47 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:56:47 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:56:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:56:47 user nova-compute[75648]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f (non-flash)
Nov 15 05:56:47 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:56:47 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:56:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ced40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f'): ({'sdf'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Removing single pathed devices sdf {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e689cba-5dfa-4f04-830e-54f063fe7c6c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f212ef09-96c0-4d17-9a4d-391be4e1f8f7]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flushing IO for device /dev/sdf {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f9f7605-70b6-4b68-9c35-950eb418ebbb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1e396-5061-4ffe-bb9f-fffd92521f29]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] SCSI volumes sdf have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23466313736663634', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2856b19f', '/dev/disk/by-id/scsi-1SCST_BIO2856b19f-4f176f643d2b071d') {{(pid=87015) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2982918-ce3b-4ddd-80fc-2ff3b84c9626]: (4, None) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee57b51-a9f6-42cf-bb12-296f6f3d10b0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf3ce04-4c49-4f52-9c95-872b4ec47a3c]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260]
Nov 15 05:56:47 user nova-compute[75648]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f, portal: 172.16.0.220,3260] successful.
Nov 15 05:56:47 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4fa6f397-6fd1-4288-8d83-f067873acd2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bdf620-0845-4cce-9bed-39cb230a4f05]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== disconnect_volume: return (316ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:56:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Deleting instance files /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17_del
Nov 15 05:56:47 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Deletion of /opt/stack/data/nova/instances/64004f1c-2f3f-4d02-8632-823a13493b17_del complete
Nov 15 05:56:47 user nova-compute[75648]: INFO nova.compute.manager [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 05:56:47 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:56:47 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:48 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Took 0.41 seconds to deallocate network for instance.
Nov 15 05:56:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-11766483-5f0e-4915-96fb-5a135deb84eb req-ac630ffe-7868-4daf-a5d5-179b651336c2 service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-deleted-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-37a765dd-a4ff-403e-bd17-83210804d9dc req-35c08cec-3875-4fd1-9f99-c027207dc38a service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37a765dd-a4ff-403e-bd17-83210804d9dc req-35c08cec-3875-4fd1-9f99-c027207dc38a service nova] Acquiring lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37a765dd-a4ff-403e-bd17-83210804d9dc req-35c08cec-3875-4fd1-9f99-c027207dc38a service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37a765dd-a4ff-403e-bd17-83210804d9dc req-35c08cec-3875-4fd1-9f99-c027207dc38a service nova] Lock "64004f1c-2f3f-4d02-8632-823a13493b17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-37a765dd-a4ff-403e-bd17-83210804d9dc req-35c08cec-3875-4fd1-9f99-c027207dc38a service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] No waiting events found dispatching network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:48 user nova-compute[75648]: WARNING nova.compute.manager [req-37a765dd-a4ff-403e-bd17-83210804d9dc req-35c08cec-3875-4fd1-9f99-c027207dc38a service nova] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Received unexpected event network-vif-plugged-a6ef8671-4b2e-4715-a58c-ebc9ea360446 for instance with vm_state active and task_state deleting.
Nov 15 05:56:48 user nova-compute[75648]: INFO nova.compute.manager [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 64004f1c-2f3f-4d02-8632-823a13493b17] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 05:56:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:49 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:56:49 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:56:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:49 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Deleted allocations for instance 64004f1c-2f3f-4d02-8632-823a13493b17
Nov 15 05:56:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-201026ec-d995-4aba-9520-919565eeeb00 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "64004f1c-2f3f-4d02-8632-823a13493b17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.808s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-changed-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Refreshing instance network info cache due to event network-changed-0a50a2d2-525f-46dc-be05-dc1339bbd1c2. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] Acquiring lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] Acquired lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Refreshing network info cache for port 0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "e7501fb9-059b-4dad-948f-6779891e0e58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:56 user nova-compute[75648]: INFO nova.compute.manager [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Terminating instance
Nov 15 05:56:56 user nova-compute[75648]: DEBUG nova.compute.manager [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Updated VIF entry in instance network info cache for port 0a50a2d2-525f-46dc-be05-dc1339bbd1c2. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Updating instance_info_cache with network_info: [{"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-49f950e9-e992-40e0-b104-c98acc6f129f req-764b9c9b-4d61-4367-be1b-1bf946dc1b09 service nova] Releasing lock "refresh_cache-e7501fb9-059b-4dad-948f-6779891e0e58" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-8cea6765-43e6-4a49-acf5-03b65e909116 req-f4a24347-865e-43e1-a711-fbeca25b7e56 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-vif-unplugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8cea6765-43e6-4a49-acf5-03b65e909116 req-f4a24347-865e-43e1-a711-fbeca25b7e56 service nova] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8cea6765-43e6-4a49-acf5-03b65e909116 req-f4a24347-865e-43e1-a711-fbeca25b7e56 service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8cea6765-43e6-4a49-acf5-03b65e909116 req-f4a24347-865e-43e1-a711-fbeca25b7e56 service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-8cea6765-43e6-4a49-acf5-03b65e909116 req-f4a24347-865e-43e1-a711-fbeca25b7e56 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] No waiting events found dispatching network-vif-unplugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-8cea6765-43e6-4a49-acf5-03b65e909116 req-f4a24347-865e-43e1-a711-fbeca25b7e56 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-vif-unplugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Instance destroyed successfully.
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'resources' on Instance uuid e7501fb9-059b-4dad-948f-6779891e0e58 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1329161386',display_name='tempest-AttachVolumeNegativeTest-server-1329161386',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1329161386',id=42,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEulkfTKE/qiZOQqcnBE34zuO175UGNFR5QPgjXSJqCVs8EIP0/YpFOBHvcoNwo4VOmyOdM0MpI2jq98duqErAUECFQywgtbI75XxqKKFwU75/RlYckrDG2/+Wcr7dILsg==',key_name='tempest-keypair-285306468',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-x9pl7zbn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=e7501fb9-059b-4dad-948f-6779891e0e58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "address": "fa:16:3e:e8:e5:e0", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a50a2d2-52", "ovs_interfaceid": "0a50a2d2-525f-46dc-be05-dc1339bbd1c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG os_vif [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a50a2d2-52, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e3b2f85-0163-41ee-8477-c75b0bec4fab) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:56:57 user nova-compute[75648]: INFO os_vif [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:e5:e0,bridge_name='br-int',has_traffic_filtering=True,id=0a50a2d2-525f-46dc-be05-dc1339bbd1c2,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a50a2d2-52')
Nov 15 05:56:57 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Deleting instance files /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58_del
Nov 15 05:56:57 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Deletion of /opt/stack/data/nova/instances/e7501fb9-059b-4dad-948f-6779891e0e58_del complete
Nov 15 05:56:57 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:57 user nova-compute[75648]: INFO nova.compute.manager [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 15 05:56:57 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:56:57 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:56:58 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Took 0.75 seconds to deallocate network for instance.
Nov 15 05:56:58 user nova-compute[75648]: DEBUG nova.compute.manager [req-837b4985-b18e-43ce-95f9-bcd2b24c232f req-aae55954-66be-4665-b35b-8be9d21b91d8 service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-vif-deleted-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:56:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:58 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Deleted allocations for instance e7501fb9-059b-4dad-948f-6779891e0e58
Nov 15 05:56:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3142e0fb-379f-4a50-a5d2-32a09d839b4c tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "e7501fb9-059b-4dad-948f-6779891e0e58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.165s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-2163c797-b4a8-437c-b129-53c5fc1f3e88 req-629da6e1-9d00-4b2d-83ba-d11fc53fdc1e service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received event network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:56:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2163c797-b4a8-437c-b129-53c5fc1f3e88 req-629da6e1-9d00-4b2d-83ba-d11fc53fdc1e service nova] Acquiring lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:56:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2163c797-b4a8-437c-b129-53c5fc1f3e88 req-629da6e1-9d00-4b2d-83ba-d11fc53fdc1e service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:56:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2163c797-b4a8-437c-b129-53c5fc1f3e88 req-629da6e1-9d00-4b2d-83ba-d11fc53fdc1e service nova] Lock "e7501fb9-059b-4dad-948f-6779891e0e58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:56:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-2163c797-b4a8-437c-b129-53c5fc1f3e88 req-629da6e1-9d00-4b2d-83ba-d11fc53fdc1e service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] No waiting events found dispatching network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:56:59 user nova-compute[75648]: WARNING nova.compute.manager [req-2163c797-b4a8-437c-b129-53c5fc1f3e88 req-629da6e1-9d00-4b2d-83ba-d11fc53fdc1e service nova] [instance: e7501fb9-059b-4dad-948f-6779891e0e58] Received unexpected event network-vif-plugged-0a50a2d2-525f-46dc-be05-dc1339bbd1c2 for instance with vm_state deleted and task_state None.
Nov 15 05:57:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-changed-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Refreshing instance network info cache due to event network-changed-8420ab57-d939-403c-8051-094cc2dc2e76. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG nova.network.neutron [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Refreshing network info cache for port 8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updated VIF entry in instance network info cache for port 8420ab57-d939-403c-8051-094cc2dc2e76. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG nova.network.neutron [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aec2ec9b-c241-4101-bafb-df7dc80f6002 req-670877bd-65ad-4ec2-99a7-667106d68744 service nova] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:57:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:57:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=7974MB free_disk=24.931503295898438GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 94a41326-1559-42e7-a95f-9e86259b26ef actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cfba25df-06bc-4064-a681-e39c39bff579 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e21dec3d-4aa8-4066-99c8-2782c41f913e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:05 user nova-compute[75648]: INFO nova.compute.manager [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Attaching volume 7e561568-26fb-4b2c-8e82-78ef935f4202 to /dev/vdb
Nov 15 05:57:06 user nova-compute[75648]: DEBUG os_brick.utils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[158e3bc0-3f61-4691-b107-2e654f773c1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e190692-891c-4521-a736-4418a03cdf0e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4385bd-afbb-46e6-96cf-8adfbc95a72f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc5b79-55b2-4bfc-9db2-60dd3e42837d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:57:06 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2dfc75-1a2f-41cd-af03-8dbda2871598]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG os_brick.utils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating existing volume attachment record: 4b4c3b67-ed08-495a-b1e7-ebcdb01807b6 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:57:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.534s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:57:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:57:10 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:57:10 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:57:10 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b010bdf9-3b0d-46a0-aaa1-4d4d912dd1a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:57:10 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a8b6ec-0fa8-47d4-9563-ae6828d736c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202] added
Nov 15 05:57:10 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1d3ea-9f62-474d-b500-98e33bb95563]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0381417c-1dc9-44c8-ab82-b6438630f911]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWKuoMbT {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWKuoMbT" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9808886-1098-4814-8fad-ad264f0b57d8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWKuoMbT'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc59ddce-89c3-45b1-8372-e44e71d10a40]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35bff49-79e1-4b7b-8b7d-7d02ddab9a87]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9212f259-b16f-46d0-8da1-5e51cd575e56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]
Nov 15 05:57:11 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.
Nov 15 05:57:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31f4b71-7ca4-4f57-b07e-b4e8f8e17723]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3281f9e4-291a-4d5f-bee3-c829af9999f0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:11 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52fd805-edcc-4338-8255-9adee1285b6b]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:57:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23630346339376239', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630346339376239', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:57:12 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:12 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 05:57:12 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:12 user nova-compute[75648]:   <serial>7e561568-26fb-4b2c-8e82-78ef935f4202</serial>
Nov 15 05:57:12 user nova-compute[75648]: </disk>
Nov 15 05:57:12 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No VIF found with MAC fa:16:3e:09:b5:d1, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:57:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5cfae05e-55ed-4548-bbb2-50b02ba2fcdb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.816s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75648) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-5befae22-d607-49d5-b517-ce6264fbf842 req-97483962-7973-4504-95e4-0d7720bc9e89 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5befae22-d607-49d5-b517-ce6264fbf842 req-97483962-7973-4504-95e4-0d7720bc9e89 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5befae22-d607-49d5-b517-ce6264fbf842 req-97483962-7973-4504-95e4-0d7720bc9e89 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5befae22-d607-49d5-b517-ce6264fbf842 req-97483962-7973-4504-95e4-0d7720bc9e89 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-5befae22-d607-49d5-b517-ce6264fbf842 req-97483962-7973-4504-95e4-0d7720bc9e89 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:57:14 user nova-compute[75648]: WARNING nova.compute.manager [req-5befae22-d607-49d5-b517-ce6264fbf842 req-97483962-7973-4504-95e4-0d7720bc9e89 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state active and task_state powering-off.
Nov 15 05:57:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance destroyed successfully.
Nov 15 05:57:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:57:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-53737dd1-8e98-4ced-bb0a-60b16fcca8f6 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.873s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:57:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-6ee2a489-a63e-4ff3-a994-98aa91f3a806 req-47dbecfb-ed98-41dc-a6e0-c7b0ef39396a service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ee2a489-a63e-4ff3-a994-98aa91f3a806 req-47dbecfb-ed98-41dc-a6e0-c7b0ef39396a service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ee2a489-a63e-4ff3-a994-98aa91f3a806 req-47dbecfb-ed98-41dc-a6e0-c7b0ef39396a service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6ee2a489-a63e-4ff3-a994-98aa91f3a806 req-47dbecfb-ed98-41dc-a6e0-c7b0ef39396a service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:16 user nova-compute[75648]: DEBUG nova.compute.manager [req-6ee2a489-a63e-4ff3-a994-98aa91f3a806 req-47dbecfb-ed98-41dc-a6e0-c7b0ef39396a service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:57:16 user nova-compute[75648]: WARNING nova.compute.manager [req-6ee2a489-a63e-4ff3-a994-98aa91f3a806 req-47dbecfb-ed98-41dc-a6e0-c7b0ef39396a service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state stopped and task_state None.
Nov 15 05:57:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:18 user nova-compute[75648]: INFO nova.compute.manager [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Detaching volume b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:57:18 user nova-compute[75648]: INFO nova.virt.block_device [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Attempting to driver detach volume b6901133-2c39-4b86-9d2e-58a21eddcaec from mountpoint /dev/vdb
Nov 15 05:57:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Attempting to detach device vdb from instance cfba25df-06bc-4064-a681-e39c39bff579 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:57:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:57:18 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:18 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:57:18 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:18 user nova-compute[75648]:   <serial>b6901133-2c39-4b86-9d2e-58a21eddcaec</serial>
Nov 15 05:57:18 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 05:57:18 user nova-compute[75648]: </disk>
Nov 15 05:57:18 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:57:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully detached device vdb from instance cfba25df-06bc-4064-a681-e39c39bff579 from the persistent domain config.
Nov 15 05:57:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cfba25df-06bc-4064-a681-e39c39bff579 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:57:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:57:18 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:18 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:57:18 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:18 user nova-compute[75648]:   <serial>b6901133-2c39-4b86-9d2e-58a21eddcaec</serial>
Nov 15 05:57:18 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 05:57:18 user nova-compute[75648]: </disk>
Nov 15 05:57:18 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:57:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:57:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-changed-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Refreshing instance network info cache due to event network-changed-4b5abff5-290e-466d-8fb6-a7fe513056cd. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:57:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] Acquiring lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:57:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] Acquired lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:57:36 user nova-compute[75648]: DEBUG nova.network.neutron [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Refreshing network info cache for port 4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updated VIF entry in instance network info cache for port 4b5abff5-290e-466d-8fb6-a7fe513056cd. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG nova.network.neutron [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating instance_info_cache with network_info: [{"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-11f33e88-701e-4d1a-b7dc-0e703b4d79ff req-ae543ac4-6124-4f61-a132-2abe74a9787f service nova] Releasing lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "94a41326-1559-42e7-a95f-9e86259b26ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:37 user nova-compute[75648]: INFO nova.compute.manager [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Terminating instance
Nov 15 05:57:37 user nova-compute[75648]: DEBUG nova.compute.manager [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Instance destroyed successfully.
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'resources' on Instance uuid 94a41326-1559-42e7-a95f-9e86259b26ef {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:47:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1341006442',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1341006442',id=30,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:47:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-53ed82va',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:49:21Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=94a41326-1559-42e7-a95f-9e86259b26ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "address": "fa:16:3e:e8:70:6c", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape53db8ff-23", "ovs_interfaceid": "e53db8ff-23fe-434b-98cc-38c4fbc35114", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG os_vif [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape53db8ff-23, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7dc8478-e562-4da1-8ac0-8a20eabb84d4) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: INFO os_vif [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:70:6c,bridge_name='br-int',has_traffic_filtering=True,id=e53db8ff-23fe-434b-98cc-38c4fbc35114,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape53db8ff-23')
Nov 15 05:57:38 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Deleting instance files /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef_del
Nov 15 05:57:38 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Deletion of /opt/stack/data/nova/instances/94a41326-1559-42e7-a95f-9e86259b26ef_del complete
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-vif-unplugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] No waiting events found dispatching network-vif-unplugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-vif-unplugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] Acquiring lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] Lock "94a41326-1559-42e7-a95f-9e86259b26ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] No waiting events found dispatching network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:57:38 user nova-compute[75648]: WARNING nova.compute.manager [req-d8ef25a9-4e70-4a08-a1a0-d3f79232d01d req-0a2ded4e-755e-4371-9a0c-50b854e331c2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received unexpected event network-vif-plugged-e53db8ff-23fe-434b-98cc-38c4fbc35114 for instance with vm_state active and task_state deleting.
Nov 15 05:57:38 user nova-compute[75648]: INFO nova.compute.manager [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:57:38 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Took 0.58 seconds to deallocate network for instance.
Nov 15 05:57:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-69ee33f3-5534-4465-bc67-aea90f0420f1 req-4a3d5120-770a-46a1-8116-06e44b4082a2 service nova] [instance: 94a41326-1559-42e7-a95f-9e86259b26ef] Received event network-vif-deleted-e53db8ff-23fe-434b-98cc-38c4fbc35114 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:38 user nova-compute[75648]: INFO nova.compute.manager [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attaching volume cff05946-c400-46c5-8429-e75d33246a90 to /dev/vdb
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.utils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5962f074-9097-4589-884b-06f6f8a5714d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadf8f6a-046f-47b8-8d8f-3b93e6eab232]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce43808-1165-4fde-aab9-164864c67519]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[73328edf-7b91-48ba-ba95-b1af02e4f0c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:57:39 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b7d8ac-3d56-4baa-9b41-dbde49f4ceb3]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.utils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating existing volume attachment record: c4fa7b3e-0cb8-455f-b35f-6355d3b362a6 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:57:39 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cfba25df-06bc-4064-a681-e39c39bff579 is timed out.
Nov 15 05:57:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully detached device vdb from instance cfba25df-06bc-4064-a681-e39c39bff579 from the live domain config.
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kKfWswXx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:57:39 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[75971668-5400-435e-921b-13af82d01400]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:57:39 user nova-compute[75648]: No targets found.
Nov 15 05:57:39 user nova-compute[75648]: iSNS:
Nov 15 05:57:39 user nova-compute[75648]: No targets found.
Nov 15 05:57:39 user nova-compute[75648]: STATIC:
Nov 15 05:57:39 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec
Nov 15 05:57:39 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:57:39 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:57:39 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 05:57:39 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:57:39 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:57:39 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:57:39 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:57:39 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:57:39 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:57:39 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:57:39 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:57:39 user nova-compute[75648]: FIRMWARE:
Nov 15 05:57:39 user nova-compute[75648]: No targets found.
Nov 15 05:57:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:57:39 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:57:39 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d155e86e-aadc-4d7a-bf2c-3368e5f0d505]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa9d5ec-6b31-41f9-b220-bfec0fec4176]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:39 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:57:39 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:39 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:39 user nova-compute[75648]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec (non-flash)
Nov 15 05:57:39 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:39 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47bac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.091s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:57:39 user nova-compute[75648]: INFO nova.compute.claims [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Claim successful on node user
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97ecab6-30ca-4b62-8e52-5d6b20ac5891]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Deleted allocations for instance 94a41326-1559-42e7-a95f-9e86259b26ef
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e309703e-f72c-4c74-ba75-94485abfdd52]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5548f6-39ea-43e2-ac6d-1886c7b3479c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[488cf273-c53a-491f-a4ac-4f89d5cc7983]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-a9ef6f78-389b-408d-9c13-9aa526a12e99 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "94a41326-1559-42e7-a95f-9e86259b26ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[226a3f0a-c7e6-4859-8e13-e14c1bdefcb7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36e6f9e-4eb2-448f-bdab-6b2017443bc0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260]
Nov 15 05:57:39 user nova-compute[75648]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec, portal: 172.16.0.220,3260] successful.
Nov 15 05:57:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6901133-2c39-4b86-9d2e-58a21eddcaec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e495bb46-ca76-468a-9e60-6af080559aba]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== disconnect_volume: return (330ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:57:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:57:39 user nova-compute[75648]: DEBUG nova.policy [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '98f7959b33774884898e9676593c3a5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ff44a3c0aa834bb0a91de95cf995b748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:57:40 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Creating image(s)
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "/opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "/opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "/opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'flavor' on Instance uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk 1073741824" returned: 0 in 0.051s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cc3cae55-cc3f-4b2e-a089-7e32ba2c57aa tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.820s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Successfully created port: 05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.202s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Cannot resize image /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Ensure instance console log exists: /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Successfully updated port: 05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquired lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-changed-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.compute.manager [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Refreshing instance network info cache due to event network-changed-05d5edc1-714b-4a82-bcdc-54fab89f7843. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] Acquiring lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updating instance_info_cache with network_info: [{"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Releasing lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Instance network_info: |[{"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] Acquired lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Refreshing network info cache for port 05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Start _get_guest_xml network_info=[{"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:57:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:57:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:57:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1995337',id=45,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCr89xaqZtEdDqyRa1c6egF6l9gH2P+UIAlDfPyBYRSEI2nV4lCFHYQ2i68/2iHi2i7XN7cGXOoGNpxpK+732fzEm7nCbna7kk/lL53FTdkKlMupq80gTO7fB/9Tn7Sw==',key_name='tempest-keypair-563196640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff44a3c0aa834bb0a91de95cf995b748',ramdisk_id='',reservation_id='r-ftuk0wsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1965904680',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98f7959b33774884898e9676593c3a5e',uuid=2026767b-71cf-48f6-8f2f-7d331bad9aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Converting VIF {"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lazy-loading 'pci_devices' on Instance uuid 2026767b-71cf-48f6-8f2f-7d331bad9aeb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:57:42 user nova-compute[75648]:   <uuid>2026767b-71cf-48f6-8f2f-7d331bad9aeb</uuid>
Nov 15 05:57:42 user nova-compute[75648]:   <name>instance-0000002d</name>
Nov 15 05:57:42 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:57:42 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:57:42 user nova-compute[75648]:   <metadata>
Nov 15 05:57:42 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:57:42 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:57:42 user nova-compute[75648]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646</nova:name>
Nov 15 05:57:42 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:57:41</nova:creationTime>
Nov 15 05:57:42 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:57:42 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:57:42 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:57:42 user nova-compute[75648]:       <nova:owner>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:user uuid="98f7959b33774884898e9676593c3a5e">tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member</nova:user>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:project uuid="ff44a3c0aa834bb0a91de95cf995b748">tempest-TestServerVolumeAttachScenarioOldVersion-1965904680</nova:project>
Nov 15 05:57:42 user nova-compute[75648]:       </nova:owner>
Nov 15 05:57:42 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:57:42 user nova-compute[75648]:       <nova:ports>
Nov 15 05:57:42 user nova-compute[75648]:         <nova:port uuid="05d5edc1-714b-4a82-bcdc-54fab89f7843">
Nov 15 05:57:42 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 15 05:57:42 user nova-compute[75648]:         </nova:port>
Nov 15 05:57:42 user nova-compute[75648]:       </nova:ports>
Nov 15 05:57:42 user nova-compute[75648]:     </nova:instance>
Nov 15 05:57:42 user nova-compute[75648]:   </metadata>
Nov 15 05:57:42 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:57:42 user nova-compute[75648]:     <system>
Nov 15 05:57:42 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:57:42 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:57:42 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:57:42 user nova-compute[75648]:       <entry name="serial">2026767b-71cf-48f6-8f2f-7d331bad9aeb</entry>
Nov 15 05:57:42 user nova-compute[75648]:       <entry name="uuid">2026767b-71cf-48f6-8f2f-7d331bad9aeb</entry>
Nov 15 05:57:42 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:57:42 user nova-compute[75648]:     </system>
Nov 15 05:57:42 user nova-compute[75648]:   </sysinfo>
Nov 15 05:57:42 user nova-compute[75648]:   <os>
Nov 15 05:57:42 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:57:42 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:57:42 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:57:42 user nova-compute[75648]:   </os>
Nov 15 05:57:42 user nova-compute[75648]:   <features>
Nov 15 05:57:42 user nova-compute[75648]:     <acpi/>
Nov 15 05:57:42 user nova-compute[75648]:     <apic/>
Nov 15 05:57:42 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:57:42 user nova-compute[75648]:   </features>
Nov 15 05:57:42 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:57:42 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:57:42 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:57:42 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:57:42 user nova-compute[75648]:   </clock>
Nov 15 05:57:42 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:57:42 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:57:42 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:57:42 user nova-compute[75648]:   </cpu>
Nov 15 05:57:42 user nova-compute[75648]:   <devices>
Nov 15 05:57:42 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:57:42 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:57:42 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk"/>
Nov 15 05:57:42 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:57:42 user nova-compute[75648]:     </disk>
Nov 15 05:57:42 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:57:42 user nova-compute[75648]:       <mac address="fa:16:3e:f6:47:06"/>
Nov 15 05:57:42 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:57:42 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:57:42 user nova-compute[75648]:       <target dev="tap05d5edc1-71"/>
Nov 15 05:57:42 user nova-compute[75648]:     </interface>
Nov 15 05:57:42 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:57:42 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/console.log" append="off"/>
Nov 15 05:57:42 user nova-compute[75648]:     </serial>
Nov 15 05:57:42 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:57:42 user nova-compute[75648]:     <video>
Nov 15 05:57:42 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:57:42 user nova-compute[75648]:     </video>
Nov 15 05:57:42 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:57:42 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:57:42 user nova-compute[75648]:     </rng>
Nov 15 05:57:42 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:57:42 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:57:42 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:57:42 user nova-compute[75648]:     </memballoon>
Nov 15 05:57:42 user nova-compute[75648]:   </devices>
Nov 15 05:57:42 user nova-compute[75648]: </domain>
Nov 15 05:57:42 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1995337',id=45,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCr89xaqZtEdDqyRa1c6egF6l9gH2P+UIAlDfPyBYRSEI2nV4lCFHYQ2i68/2iHi2i7XN7cGXOoGNpxpK+732fzEm7nCbna7kk/lL53FTdkKlMupq80gTO7fB/9Tn7Sw==',key_name='tempest-keypair-563196640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ff44a3c0aa834bb0a91de95cf995b748',ramdisk_id='',reservation_id='r-ftuk0wsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1965904680',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:57:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98f7959b33774884898e9676593c3a5e',uuid=2026767b-71cf-48f6-8f2f-7d331bad9aeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Converting VIF {"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG os_vif [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '667c8343-bfe9-578e-80b1-eb7c38976479', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap05d5edc1-71, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap05d5edc1-71, col_values=(('qos', UUID('11741f3a-0d25-40ea-a9e1-6c24f97c0651')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap05d5edc1-71, col_values=(('external_ids', {'iface-id': '05d5edc1-714b-4a82-bcdc-54fab89f7843', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:47:06', 'vm-uuid': '2026767b-71cf-48f6-8f2f-7d331bad9aeb'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:42 user nova-compute[75648]: INFO os_vif [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71')
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] No VIF found with MAC fa:16:3e:f6:47:06, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updated VIF entry in instance network info cache for port 05d5edc1-714b-4a82-bcdc-54fab89f7843. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG nova.network.neutron [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updating instance_info_cache with network_info: [{"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:57:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-619703c6-3e79-4a48-8f64-fde7d4c62b76 req-c4935381-80d0-4e7a-b382-973f5ff7255f service nova] Releasing lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-fbf5a52e-ace3-4e9e-8aa8-d272032ed3b9 req-2d142710-5de1-41e4-aa3f-d3e64614672b service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fbf5a52e-ace3-4e9e-8aa8-d272032ed3b9 req-2d142710-5de1-41e4-aa3f-d3e64614672b service nova] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fbf5a52e-ace3-4e9e-8aa8-d272032ed3b9 req-2d142710-5de1-41e4-aa3f-d3e64614672b service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fbf5a52e-ace3-4e9e-8aa8-d272032ed3b9 req-2d142710-5de1-41e4-aa3f-d3e64614672b service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG nova.compute.manager [req-fbf5a52e-ace3-4e9e-8aa8-d272032ed3b9 req-2d142710-5de1-41e4-aa3f-d3e64614672b service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] No waiting events found dispatching network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:57:43 user nova-compute[75648]: WARNING nova.compute.manager [req-fbf5a52e-ace3-4e9e-8aa8-d272032ed3b9 req-2d142710-5de1-41e4-aa3f-d3e64614672b service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received unexpected event network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 for instance with vm_state building and task_state spawning.
Nov 15 05:57:43 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcHabJUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:57:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:57:43 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:57:43 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f38e91-8710-4316-887a-d3cad6a12912]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:57:43 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa2a086-59e2-4e23-9e05-f00f88afa6ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90] added
Nov 15 05:57:43 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec6e8b-dc79-4cb8-8e30-876e507c2307]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a11fac8-3d89-402b-a77a-52a10bcbdbf8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:43 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcHabJUj {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CcHabJUj" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5f8af-a0e0-42f6-a261-a6ad0a15ac94]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CcHabJUj'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f85572-7f3a-421a-a486-3d56b918575c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6b751-4f44-417e-b8a7-315fa3a8917b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5c5ecc-49ed-4c2e-a3ec-1e38425f401e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260]
Nov 15 05:57:44 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260] successful.
Nov 15 05:57:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea61cfd2-8103-41cb-9b17-e8ab49f646af]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ac2e2-1831-43f6-8499-fd82367d6a34]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)
Nov 15 05:57:44 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[934ea5a3-1edd-4a13-b151-daf4d4704ff5]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:57:44 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcHabJUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23039323330363464', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039323330363464', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:57:45 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:45 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:57:45 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:45 user nova-compute[75648]:   <serial>cff05946-c400-46c5-8429-e75d33246a90</serial>
Nov 15 05:57:45 user nova-compute[75648]: </disk>
Nov 15 05:57:45 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:57:45 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Instance spawned successfully.
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:57:45 user nova-compute[75648]: INFO nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Took 5.58 seconds to spawn the instance on the hypervisor.
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:57:45 user nova-compute[75648]: INFO nova.compute.manager [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Took 6.42 seconds to build instance.
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No VIF found with MAC fa:16:3e:09:c2:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4a4c21ab-b2be-412b-b9df-2af33dc5669b tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.540s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-f90e5535-3398-4551-b25d-87669e8983ee req-1fbe3b8f-0012-4e8f-aa72-a19b68614535 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f90e5535-3398-4551-b25d-87669e8983ee req-1fbe3b8f-0012-4e8f-aa72-a19b68614535 service nova] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f90e5535-3398-4551-b25d-87669e8983ee req-1fbe3b8f-0012-4e8f-aa72-a19b68614535 service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f90e5535-3398-4551-b25d-87669e8983ee req-1fbe3b8f-0012-4e8f-aa72-a19b68614535 service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:45 user nova-compute[75648]: DEBUG nova.compute.manager [req-f90e5535-3398-4551-b25d-87669e8983ee req-1fbe3b8f-0012-4e8f-aa72-a19b68614535 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] No waiting events found dispatching network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:57:45 user nova-compute[75648]: WARNING nova.compute.manager [req-f90e5535-3398-4551-b25d-87669e8983ee req-1fbe3b8f-0012-4e8f-aa72-a19b68614535 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received unexpected event network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 for instance with vm_state active and task_state None.
Nov 15 05:57:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e084c40f-ea22-481e-99ca-f50e423851ef tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.844s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:57:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:48 user nova-compute[75648]: INFO nova.compute.manager [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Detaching volume 5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:57:48 user nova-compute[75648]: INFO nova.virt.block_device [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Attempting to driver detach volume 5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 from mountpoint /dev/vdb
Nov 15 05:57:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Attempting to detach device vdb from instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:57:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:57:48 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:48 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:57:48 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:48 user nova-compute[75648]:   <serial>5c00e9c3-3229-47c5-82f7-2ae1085ff5d4</serial>
Nov 15 05:57:48 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:57:48 user nova-compute[75648]: </disk>
Nov 15 05:57:48 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:57:48 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully detached device vdb from instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 from the persistent domain config.
Nov 15 05:57:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:57:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:57:48 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:48 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 05:57:48 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:48 user nova-compute[75648]:   <serial>5c00e9c3-3229-47c5-82f7-2ae1085ff5d4</serial>
Nov 15 05:57:48 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:57:48 user nova-compute[75648]: </disk>
Nov 15 05:57:48 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:57:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:48 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:57:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:57:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:57:54 user nova-compute[75648]: INFO nova.compute.manager [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Detaching volume cff05946-c400-46c5-8429-e75d33246a90
Nov 15 05:57:54 user nova-compute[75648]: INFO nova.virt.block_device [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attempting to driver detach volume cff05946-c400-46c5-8429-e75d33246a90 from mountpoint /dev/vdb
Nov 15 05:57:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Attempting to detach device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:57:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:57:54 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:54 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:57:54 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:54 user nova-compute[75648]:   <serial>cff05946-c400-46c5-8429-e75d33246a90</serial>
Nov 15 05:57:54 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:57:54 user nova-compute[75648]: </disk>
Nov 15 05:57:54 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:57:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config.
Nov 15 05:57:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:57:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:57:54 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:57:54 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:57:54 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:57:54 user nova-compute[75648]:   <serial>cff05946-c400-46c5-8429-e75d33246a90</serial>
Nov 15 05:57:54 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:57:54 user nova-compute[75648]: </disk>
Nov 15 05:57:54 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:57:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:57:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:57:58 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:58:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:58:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8164MB free_disk=25.017559051513672GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance cfba25df-06bc-4064-a681-e39c39bff579 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e21dec3d-4aa8-4066-99c8-2782c41f913e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:58:05 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:58:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:58:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:58:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.387s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid f66dc876-aae4-4e20-8b96-c47a8e3dff60 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [{"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-f66dc876-aae4-4e20-8b96-c47a8e3dff60" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:58:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 is timed out.
Nov 15 05:58:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully detached device vdb from instance 7b7a666d-f7cb-4550-a21b-f843323e40e0 from the live domain config.
Nov 15 05:58:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AgdBuHeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:08 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa05783-80e5-400c-9b83-4ae540b64665]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:58:08 user nova-compute[75648]: No targets found.
Nov 15 05:58:08 user nova-compute[75648]: iSNS:
Nov 15 05:58:08 user nova-compute[75648]: No targets found.
Nov 15 05:58:08 user nova-compute[75648]: STATIC:
Nov 15 05:58:08 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 05:58:08 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:08 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:08 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:58:08 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:08 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:08 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90
Nov 15 05:58:08 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:08 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:08 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4
Nov 15 05:58:08 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:08 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:08 user nova-compute[75648]: FIRMWARE:
Nov 15 05:58:08 user nova-compute[75648]: No targets found.
Nov 15 05:58:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:58:08 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:58:08 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3841c7e5-ccf2-42ca-8004-8716e2b0334d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd93d1-1424-4f00-a481-c1aec8022384]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:08 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:58:08 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:08 user nova-compute[75648]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)
Nov 15 05:58:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:08 user nova-compute[75648]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 (non-flash)
Nov 15 05:58:08 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:08 user nova-compute[75648]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)
Nov 15 05:58:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c4518e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7670db56-9859-4cfc-84d5-ac041275b85d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0bff6ab-033a-4124-bc55-b3562f1f8732]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cce84ad-9d63-4395-acaf-ababfacd97fd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ab0c36-1a1e-4f07-8366-d97a8abfdfab]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[02321b3a-12d5-42e7-86d6-6a91f48f98a6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdef759-dd8b-41dd-a963-68ca56ea5a4e]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260]
Nov 15 05:58:09 user nova-compute[75648]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4, portal: 172.16.0.220,3260] successful.
Nov 15 05:58:09 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:09 user nova-compute[75648]: INFO nova.compute.manager [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Terminating instance
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5c00e9c3-3229-47c5-82f7-2ae1085ff5d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a991c8-05d2-4f4b-bd8b-988e0a58f137]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== disconnect_volume: return (295ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-fb8d66d1-006e-4cc9-87c8-8d8913e75c80 req-ddd3bde6-fca5-43c2-b6c1-127836598a3d service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-unplugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fb8d66d1-006e-4cc9-87c8-8d8913e75c80 req-ddd3bde6-fca5-43c2-b6c1-127836598a3d service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fb8d66d1-006e-4cc9-87c8-8d8913e75c80 req-ddd3bde6-fca5-43c2-b6c1-127836598a3d service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-fb8d66d1-006e-4cc9-87c8-8d8913e75c80 req-ddd3bde6-fca5-43c2-b6c1-127836598a3d service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-fb8d66d1-006e-4cc9-87c8-8d8913e75c80 req-ddd3bde6-fca5-43c2-b6c1-127836598a3d service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-unplugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-fb8d66d1-006e-4cc9-87c8-8d8913e75c80 req-ddd3bde6-fca5-43c2-b6c1-127836598a3d service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-unplugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:58:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Instance destroyed successfully.
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'resources' on Instance uuid cfba25df-06bc-4064-a681-e39c39bff579 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:52:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1132664164',display_name='tempest-ServerActionsTestOtherA-server-534410716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1132664164',id=38,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrMHw6CVN46QndV4fLK/dkMsjkjJ2ANmwSPlQ0Jykvkn/AVvRx4HXNbGOOm/kpUKJjPVSvEqRr9l81gzdL3tBchJJzfye99ufgHezNwSfzUqXQBsIlWt9CtZzqyBs17ag==',key_name='tempest-keypair-822930759',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:54:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-ch1ya3rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:54:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=cfba25df-06bc-4064-a681-e39c39bff579,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "address": "fa:16:3e:24:1c:02", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.199", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap738f8ceb-3e", "ovs_interfaceid": "738f8ceb-3e09-4e7e-a54a-a6118d6df7ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG os_vif [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap738f8ceb-3e, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c3b0c18-9647-47ae-a9c6-74145a4fbef1) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:09 user nova-compute[75648]: INFO os_vif [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:1c:02,bridge_name='br-int',has_traffic_filtering=True,id=738f8ceb-3e09-4e7e-a54a-a6118d6df7ec,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap738f8ceb-3e')
Nov 15 05:58:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Deleting instance files /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579_del
Nov 15 05:58:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Deletion of /opt/stack/data/nova/instances/cfba25df-06bc-4064-a681-e39c39bff579_del complete
Nov 15 05:58:09 user nova-compute[75648]: INFO nova.compute.manager [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 05:58:09 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:58:09 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8a491375-6343-4cf5-8f1a-8457ae961638 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:58:10 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Took 0.68 seconds to deallocate network for instance.
Nov 15 05:58:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:58:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:11 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Deleted allocations for instance cfba25df-06bc-4064-a681-e39c39bff579
Nov 15 05:58:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-7370f6d0-c36d-4380-9126-e4f79b1b1ea3 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "cfba25df-06bc-4064-a681-e39c39bff579" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] Acquiring lock "cfba25df-06bc-4064-a681-e39c39bff579-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] Lock "cfba25df-06bc-4064-a681-e39c39bff579-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] No waiting events found dispatching network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:11 user nova-compute[75648]: WARNING nova.compute.manager [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received unexpected event network-vif-plugged-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec for instance with vm_state deleted and task_state None.
Nov 15 05:58:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-d0bdc0b3-8c78-47f5-a397-3f7d5e658a51 req-fb8a7c47-7540-41ab-8913-a9ab61cfcf72 service nova] [instance: cfba25df-06bc-4064-a681-e39c39bff579] Received event network-vif-deleted-738f8ceb-3e09-4e7e-a54a-a6118d6df7ec {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e is timed out.
Nov 15 05:58:14 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config.
Nov 15 05:58:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CcHabJUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6fe5f-7998-4efb-88e5-16e3a660ec60]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:58:14 user nova-compute[75648]: No targets found.
Nov 15 05:58:14 user nova-compute[75648]: iSNS:
Nov 15 05:58:14 user nova-compute[75648]: No targets found.
Nov 15 05:58:14 user nova-compute[75648]: STATIC:
Nov 15 05:58:14 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 05:58:14 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:14 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:14 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:58:14 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:14 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:14 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90
Nov 15 05:58:14 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:14 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:14 user nova-compute[75648]: FIRMWARE:
Nov 15 05:58:14 user nova-compute[75648]: No targets found.
Nov 15 05:58:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:58:14 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:58:14 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c1aaa7-d901-458e-af45-2de6b93cc787]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b594f39-945b-4516-b99e-21736c7023e4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:14 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:14 user nova-compute[75648]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)
Nov 15 05:58:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:14 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:14 user nova-compute[75648]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 (non-flash)
Nov 15 05:58:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9f1462d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b31073-4204-476b-91c3-2d8101383b82]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cef8f7-59be-4477-b653-15aeb0531350]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a686daef-9354-43f6-a91a-63a65c61460d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:58:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.027s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[568884af-705c-4d0f-8688-bc33b637e896]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18512e91-1ae5-444a-8000-6ab580d27600]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d72242-4f7c-4364-b87a-211318de02ab]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260]
Nov 15 05:58:15 user nova-compute[75648]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90, portal: 172.16.0.220,3260] successful.
Nov 15 05:58:15 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cff05946-c400-46c5-8429-e75d33246a90 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc0c36c-af7d-4ba9-b446-f7cf6b0f9d81]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== disconnect_volume: return (265ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1805e02f-3f6b-461f-807c-1d03e7d2424f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.532s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:19 user nova-compute[75648]: INFO nova.compute.manager [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Unshelving
Nov 15 05:58:19 user nova-compute[75648]: INFO nova.virt.block_device [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Booting with volume 1a179055-9e6f-4f14-9c27-dafa5e297715 at /dev/vda
Nov 15 05:58:19 user nova-compute[75648]: DEBUG os_brick.utils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c250ea08-85e5-400a-85a3-e3489826feef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1b8a0a-0d85-400a-92b2-804cd6849560]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc4c39c-5da0-4e3e-8b88-f96cf5bf46d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a89aed6-f1d6-4ef5-9c8a-29d3dd7cdaf8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:58:19 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:58:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb3de4-65b0-468c-bb3b-23705cac4e5d]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG os_brick.utils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:19 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating existing volume attachment record: 4b105796-f638-440f-9433-0fe1d0602daa {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'pci_requests' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'numa_topology' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:58:24 user nova-compute[75648]: INFO nova.compute.claims [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Claim successful on node user
Nov 15 05:58:24 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:24 user nova-compute[75648]: INFO nova.network.neutron [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 15 05:58:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing instance network info cache due to event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.network.neutron [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:58:25 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Creating image(s)
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Ensure instance console log exists: /opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Start _get_guest_xml network_info=[{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '4b105796-f638-440f-9433-0fe1d0602daa', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fdf4097a-b7f0-4802-8abc-2583acd8ab84', 'attached_at': '', 'detached_at': '', 'volume_id': '1a179055-9e6f-4f14-9c27-dafa5e297715', 'serial': '1a179055-9e6f-4f14-9c27-dafa5e297715'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.network.neutron [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:58:25 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:58:25 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.objects.instance [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.objects.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Object Instance<fdf4097a-b7f0-4802-8abc-2583acd8ab84> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:25 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:25 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:25 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48bb310-7998-439a-8064-0eb86674ee57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:58:25 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff980bc5-b8d4-4a4d-ad2a-b3c74f7d34a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715] added
Nov 15 05:58:25 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b0ec77-3d5a-46ef-b3ca-fd1a87a0fbf4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76cce3e-138d-4f6e-8914-fd1bfd95599f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgQmtAJM {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bgQmtAJM" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc13a9d2-4a64-476d-b352-ff035eb11f5b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bgQmtAJM'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff4e0f0-2ebb-4744-9e63-2bd6bd938e93]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:25 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[694660cb-444f-4a59-a218-59902140084a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:26 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:26 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14e147e-b796-4d34-9c55-51f2c053e4d9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]
Nov 15 05:58:26 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.
Nov 15 05:58:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f50e06a-55fe-4898-812e-d67065c399c4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[740dd118-7a83-42d9-a0ad-8c1700077e02]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:26 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:26 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:26 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:26 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:26 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[185d88d1-74cf-47e4-a0be-6ea1b7d8297d]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG nova.network.neutron [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updated VIF entry in instance network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG nova.network.neutron [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:58:26 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a5a36642-fc4a-4bfb-a12a-f81eec0f6be2 req-9fa2411b-d4d9-4a72-b125-c393f3bb7123 service nova] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26464306534616137', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306534616137', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1341763353',display_name='tempest-TestShelveInstance-server-1341763353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1341763353',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1044638316',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb07fa691bf94a7f8a85cd8edf71b795',ramdisk_id='',reservation_id='r-2r401zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-812316993',owner_user_name='tempest-TestShelveInstance-812316993-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:58:20Z,user_data=None,user_id='eb4b0c67e9cd4a3eb697f4d2b1668fb6',uuid=fdf4097a-b7f0-4802-8abc-2583acd8ab84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converting VIF {"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.objects.instance [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'pci_devices' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.objects.base [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Object Instance<fdf4097a-b7f0-4802-8abc-2583acd8ab84> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:58:27 user nova-compute[75648]:   <uuid>fdf4097a-b7f0-4802-8abc-2583acd8ab84</uuid>
Nov 15 05:58:27 user nova-compute[75648]:   <name>instance-00000029</name>
Nov 15 05:58:27 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:58:27 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:58:27 user nova-compute[75648]:   <metadata>
Nov 15 05:58:27 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:58:27 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:58:27 user nova-compute[75648]:       <nova:name>tempest-TestShelveInstance-server-1341763353</nova:name>
Nov 15 05:58:27 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:58:25</nova:creationTime>
Nov 15 05:58:27 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:58:27 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:58:27 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:58:27 user nova-compute[75648]:       <nova:owner>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:user uuid="eb4b0c67e9cd4a3eb697f4d2b1668fb6">tempest-TestShelveInstance-812316993-project-member</nova:user>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:project uuid="bb07fa691bf94a7f8a85cd8edf71b795">tempest-TestShelveInstance-812316993</nova:project>
Nov 15 05:58:27 user nova-compute[75648]:       </nova:owner>
Nov 15 05:58:27 user nova-compute[75648]:       <nova:ports>
Nov 15 05:58:27 user nova-compute[75648]:         <nova:port uuid="9de3a7e3-3152-4276-bd9e-d3ddfcac0696">
Nov 15 05:58:27 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 15 05:58:27 user nova-compute[75648]:         </nova:port>
Nov 15 05:58:27 user nova-compute[75648]:       </nova:ports>
Nov 15 05:58:27 user nova-compute[75648]:     </nova:instance>
Nov 15 05:58:27 user nova-compute[75648]:   </metadata>
Nov 15 05:58:27 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:58:27 user nova-compute[75648]:     <system>
Nov 15 05:58:27 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:58:27 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:58:27 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:58:27 user nova-compute[75648]:       <entry name="serial">fdf4097a-b7f0-4802-8abc-2583acd8ab84</entry>
Nov 15 05:58:27 user nova-compute[75648]:       <entry name="uuid">fdf4097a-b7f0-4802-8abc-2583acd8ab84</entry>
Nov 15 05:58:27 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:58:27 user nova-compute[75648]:     </system>
Nov 15 05:58:27 user nova-compute[75648]:   </sysinfo>
Nov 15 05:58:27 user nova-compute[75648]:   <os>
Nov 15 05:58:27 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:58:27 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:58:27 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:58:27 user nova-compute[75648]:   </os>
Nov 15 05:58:27 user nova-compute[75648]:   <features>
Nov 15 05:58:27 user nova-compute[75648]:     <acpi/>
Nov 15 05:58:27 user nova-compute[75648]:     <apic/>
Nov 15 05:58:27 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:58:27 user nova-compute[75648]:   </features>
Nov 15 05:58:27 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:58:27 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:58:27 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:58:27 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:58:27 user nova-compute[75648]:   </clock>
Nov 15 05:58:27 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:58:27 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:58:27 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:58:27 user nova-compute[75648]:   </cpu>
Nov 15 05:58:27 user nova-compute[75648]:   <devices>
Nov 15 05:58:27 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:58:27 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:58:27 user nova-compute[75648]:       <source dev="/dev/sdd"/>
Nov 15 05:58:27 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:58:27 user nova-compute[75648]:       <serial>1a179055-9e6f-4f14-9c27-dafa5e297715</serial>
Nov 15 05:58:27 user nova-compute[75648]:     </disk>
Nov 15 05:58:27 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:58:27 user nova-compute[75648]:       <mac address="fa:16:3e:09:53:8c"/>
Nov 15 05:58:27 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:58:27 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:58:27 user nova-compute[75648]:       <target dev="tap9de3a7e3-31"/>
Nov 15 05:58:27 user nova-compute[75648]:     </interface>
Nov 15 05:58:27 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:58:27 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84/console.log" append="off"/>
Nov 15 05:58:27 user nova-compute[75648]:     </serial>
Nov 15 05:58:27 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:58:27 user nova-compute[75648]:     <video>
Nov 15 05:58:27 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:58:27 user nova-compute[75648]:     </video>
Nov 15 05:58:27 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:58:27 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:58:27 user nova-compute[75648]:     </rng>
Nov 15 05:58:27 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:58:27 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:58:27 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:58:27 user nova-compute[75648]:     </memballoon>
Nov 15 05:58:27 user nova-compute[75648]:   </devices>
Nov 15 05:58:27 user nova-compute[75648]: </domain>
Nov 15 05:58:27 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1341763353',display_name='tempest-TestShelveInstance-server-1341763353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1341763353',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1044638316',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='bb07fa691bf94a7f8a85cd8edf71b795',ramdisk_id='',reservation_id='r-2r401zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-812316993',owner_user_name='tempest-TestShelveInstance-812316993-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:58:20Z,user_data=None,user_id='eb4b0c67e9cd4a3eb697f4d2b1668fb6',uuid=fdf4097a-b7f0-4802-8abc-2583acd8ab84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converting VIF {"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG os_vif [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ad1070d-d490-5f06-8bba-03a847e27045', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9de3a7e3-31, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9de3a7e3-31, col_values=(('qos', UUID('757e7dae-dbc1-42a7-ae93-2d400b023eac')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9de3a7e3-31, col_values=(('external_ids', {'iface-id': '9de3a7e3-3152-4276-bd9e-d3ddfcac0696', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:53:8c', 'vm-uuid': 'fdf4097a-b7f0-4802-8abc-2583acd8ab84'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:27 user nova-compute[75648]: INFO os_vif [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31')
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] No VIF found with MAC fa:16:3e:09:53:8c, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:27 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:27 user nova-compute[75648]: INFO nova.compute.manager [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Terminating instance
Nov 15 05:58:27 user nova-compute[75648]: DEBUG nova.compute.manager [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-0d61684e-481e-498e-b114-17b7172866ec req-a54103d5-1436-47c6-b12e-109931b0c6f1 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0d61684e-481e-498e-b114-17b7172866ec req-a54103d5-1436-47c6-b12e-109931b0c6f1 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0d61684e-481e-498e-b114-17b7172866ec req-a54103d5-1436-47c6-b12e-109931b0c6f1 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-0d61684e-481e-498e-b114-17b7172866ec req-a54103d5-1436-47c6-b12e-109931b0c6f1 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-0d61684e-481e-498e-b114-17b7172866ec req-a54103d5-1436-47c6-b12e-109931b0c6f1 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG nova.compute.manager [req-0d61684e-481e-498e-b114-17b7172866ec req-a54103d5-1436-47c6-b12e-109931b0c6f1 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-unplugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Instance destroyed successfully.
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.objects.instance [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'resources' on Instance uuid 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:41:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-725986689',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-725986689',id=14,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:43:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-xqtcs61e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:45:39Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "6472c753-29dc-40b6-be7a-761e5596244a", "address": "fa:16:3e:81:0f:aa", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6472c753-29", "ovs_interfaceid": "6472c753-29dc-40b6-be7a-761e5596244a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_vif [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6472c753-29, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55a32c9d-5f03-4cd6-9034-f36141c58761) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: INFO os_vif [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:0f:aa,bridge_name='br-int',has_traffic_filtering=True,id=6472c753-29dc-40b6-be7a-761e5596244a,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6472c753-29')
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLtjXNQK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[041976b7-d28f-4cc6-b442-4fe7ea0ae05f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:58:29 user nova-compute[75648]: No targets found.
Nov 15 05:58:29 user nova-compute[75648]: iSNS:
Nov 15 05:58:29 user nova-compute[75648]: No targets found.
Nov 15 05:58:29 user nova-compute[75648]: STATIC:
Nov 15 05:58:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 05:58:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff
Nov 15 05:58:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:29 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 05:58:29 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:58:29 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:58:29 user nova-compute[75648]: FIRMWARE:
Nov 15 05:58:29 user nova-compute[75648]: No targets found.
Nov 15 05:58:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:58:29 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:58:29 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff674915-0ef5-414f-9ffc-597e2b55c105]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a06552b-c7cf-437f-89ce-80690c76f927]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:29 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:29 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff (non-flash)
Nov 15 05:58:29 user nova-compute[75648]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:29 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8657be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9af183-8dfd-49cc-96f7-25531ac73d84]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb83449-63f6-4748-a0c0-a6cd0ba6c616]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3712eb38-e6f1-4b26-81e1-cc5fc6f01361]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[047a8344-2637-4946-a074-1bab898c6d4b]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d01192a-f891-40df-b430-2968f88874bf]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f135a4-3bec-464c-9585-7d6b1b653580]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260]
Nov 15 05:58:29 user nova-compute[75648]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff, portal: 172.16.0.220,3260] successful.
Nov 15 05:58:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:986f90c5-4d1a-44ec-979f-11b82dc0e3ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab98c03-d1c4-4ce7-a516-5002ca45eba9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] <== disconnect_volume: return (283ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:58:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Deleting instance files /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3_del
Nov 15 05:58:29 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Deletion of /opt/stack/data/nova/instances/3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3_del complete
Nov 15 05:58:29 user nova-compute[75648]: INFO nova.compute.manager [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Took 1.70 seconds to destroy the instance on the hypervisor.
Nov 15 05:58:29 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:58:29 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:58:30 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Took 0.49 seconds to deallocate network for instance.
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-80ac1e4a-8d54-4b3b-8611-fe11ef60c246 req-85c84f10-5dae-42af-bd06-28ce68509a89 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-deleted-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Acquiring lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] No waiting events found dispatching network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:30 user nova-compute[75648]: WARNING nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Received unexpected event network-vif-plugged-6472c753-29dc-40b6-be7a-761e5596244a for instance with vm_state active and task_state deleting.
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:30 user nova-compute[75648]: WARNING nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:30 user nova-compute[75648]: WARNING nova.compute.manager [req-4349439a-9aec-4edf-8498-f34d6159fa1c req-483f11f3-c74b-4ac5-8d88-01c1bce31cd3 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 15 05:58:30 user nova-compute[75648]: INFO nova.compute.manager [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3] Took 0.79 seconds to detach 1 volumes for instance.
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:58:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:58:31 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance spawned successfully.
Nov 15 05:58:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:58:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-da98ff2b-5c16-4b08-95b0-a2f360d3242a tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.583s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:31 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:58:31 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:58:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:31 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Deleted allocations for instance 3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3
Nov 15 05:58:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-0dc69cfe-9e78-460c-bccf-1ac6020feef5 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "3dc57bb7-2b00-4dc0-a92e-5642d8fba6e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.487s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:38 user nova-compute[75648]: INFO nova.compute.manager [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Terminating instance
Nov 15 05:58:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-82fc165c-c69c-438a-b2be-f7a2b3d57251 req-3f178258-8fbc-4305-85d9-b5ffdc182653 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-vif-unplugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82fc165c-c69c-438a-b2be-f7a2b3d57251 req-3f178258-8fbc-4305-85d9-b5ffdc182653 service nova] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82fc165c-c69c-438a-b2be-f7a2b3d57251 req-3f178258-8fbc-4305-85d9-b5ffdc182653 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-82fc165c-c69c-438a-b2be-f7a2b3d57251 req-3f178258-8fbc-4305-85d9-b5ffdc182653 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-82fc165c-c69c-438a-b2be-f7a2b3d57251 req-3f178258-8fbc-4305-85d9-b5ffdc182653 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] No waiting events found dispatching network-vif-unplugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-82fc165c-c69c-438a-b2be-f7a2b3d57251 req-3f178258-8fbc-4305-85d9-b5ffdc182653 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-vif-unplugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:58:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Instance destroyed successfully.
Nov 15 05:58:39 user nova-compute[75648]: DEBUG nova.objects.instance [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'resources' on Instance uuid 7b7a666d-f7cb-4550-a21b-f843323e40e0 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:53:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-116234881',display_name='tempest-AttachVolumeNegativeTest-server-116234881',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-116234881',id=39,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3vg5fEpUBNKJY/6O0AJM0Hp8daStwfNGFTghRbwqSXJ+IHEc5X+V14QFYKoCEJ6qPHELCR1AkOx/DOkjBT2WEHHAHOgWnEOJhWMvr3zFwZzRqxtJnFLcQQjKqqUAutOg==',key_name='tempest-keypair-1224580510',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:53:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-499gnqbo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:53:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=7b7a666d-f7cb-4550-a21b-f843323e40e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "address": "fa:16:3e:37:5c:91", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.178", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda0d7513-b6", "ovs_interfaceid": "da0d7513-b660-42e8-9bfd-fcaa36bdff7f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG os_vif [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda0d7513-b6, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=93b67c91-684e-4afc-91b8-fcda017c5cff) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:39 user nova-compute[75648]: INFO os_vif [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:5c:91,bridge_name='br-int',has_traffic_filtering=True,id=da0d7513-b660-42e8-9bfd-fcaa36bdff7f,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda0d7513-b6')
Nov 15 05:58:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Deleting instance files /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0_del
Nov 15 05:58:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Deletion of /opt/stack/data/nova/instances/7b7a666d-f7cb-4550-a21b-f843323e40e0_del complete
Nov 15 05:58:39 user nova-compute[75648]: INFO nova.compute.manager [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 15 05:58:39 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:58:39 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:58:40 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Took 0.74 seconds to deallocate network for instance.
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.260s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:40 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Deleted allocations for instance 7b7a666d-f7cb-4550-a21b-f843323e40e0
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-dd705a63-268b-4a01-9c4c-51964d981a18 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.055s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] Acquiring lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] Lock "7b7a666d-f7cb-4550-a21b-f843323e40e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] No waiting events found dispatching network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:58:40 user nova-compute[75648]: WARNING nova.compute.manager [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received unexpected event network-vif-plugged-da0d7513-b660-42e8-9bfd-fcaa36bdff7f for instance with vm_state deleted and task_state None.
Nov 15 05:58:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-c1bbaf95-9868-4ded-a2b6-47862e40b0a7 req-71e53989-0fd6-4823-a632-b2d79c2e63d2 service nova] [instance: 7b7a666d-f7cb-4550-a21b-f843323e40e0] Received event network-vif-deleted-da0d7513-b660-42e8-9bfd-fcaa36bdff7f {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:58:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:46 user nova-compute[75648]: INFO nova.compute.manager [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attaching volume 3747730d-4fce-45cf-9372-edc07e60e6eb to /dev/vdb
Nov 15 05:58:46 user nova-compute[75648]: DEBUG os_brick.utils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb4f6d-c623-4895-ac37-fee5e2eb55f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cc158d-164a-4e9b-92dd-adf133e38e1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7eb36d-53a4-4abd-ab07-e78d3649cadd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1bdd48-54fb-4292-a914-b4796701bb7a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:58:46 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:58:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e12032c-e09a-406a-b2fb-f21406315b72]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG os_brick.utils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:46 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating existing volume attachment record: 8b3d79b2-c01d-4b80-9ca7-8edb391eee62 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:58:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwrYQoNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:58:51 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:51 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:58:51 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0680150-1d05-4118-825d-0f17ebd859bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:58:51 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db0021e-609a-4191-88e1-eb1353eeb89f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb] added
Nov 15 05:58:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[37afeb96-d82e-483e-993b-aa9b822259bb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f16994-9d28-4f82-9771-f7af76cbaad9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwrYQoNW {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dwrYQoNW" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4522915-1e2f-4c54-8edd-83cb38816bd9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dwrYQoNW'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1234e022-dc54-462d-a5bd-776baa551665]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d546814a-8d0c-4978-b308-85213a0350e0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b224b9bf-855e-47db-af02-3033ba15f020]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260]
Nov 15 05:58:51 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260] successful.
Nov 15 05:58:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a5ebe9-72ab-4165-8aa5-c8e6da8c7feb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[03947d59-0765-4210-8c52-636a954cfa12]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:58:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:58:51 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:58:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d5c7ab-125c-4126-a18f-26e9d12f6282]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:58:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwrYQoNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26432353231326333', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432353231326333', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:58:52 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:58:52 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 05:58:52 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:58:52 user nova-compute[75648]:   <serial>3747730d-4fce-45cf-9372-edc07e60e6eb</serial>
Nov 15 05:58:52 user nova-compute[75648]: </disk>
Nov 15 05:58:52 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:58:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No VIF found with MAC fa:16:3e:09:c2:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:58:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b163028b-7624-406b-93f7-7ecb3c990258 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.453s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:58:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:58:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:58:55 user nova-compute[75648]: INFO nova.compute.manager [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Detaching volume 3747730d-4fce-45cf-9372-edc07e60e6eb
Nov 15 05:58:55 user nova-compute[75648]: INFO nova.virt.block_device [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attempting to driver detach volume 3747730d-4fce-45cf-9372-edc07e60e6eb from mountpoint /dev/vdb
Nov 15 05:58:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Attempting to detach device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:58:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:58:55 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:58:55 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 05:58:55 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:58:55 user nova-compute[75648]:   <serial>3747730d-4fce-45cf-9372-edc07e60e6eb</serial>
Nov 15 05:58:55 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:58:55 user nova-compute[75648]: </disk>
Nov 15 05:58:55 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:58:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config.
Nov 15 05:58:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:58:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:58:55 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:58:55 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 05:58:55 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:58:55 user nova-compute[75648]:   <serial>3747730d-4fce-45cf-9372-edc07e60e6eb</serial>
Nov 15 05:58:55 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:58:55 user nova-compute[75648]: </disk>
Nov 15 05:58:55 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:58:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:58:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:58:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:00 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'info_cache' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:04 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:59:04 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8277MB free_disk=25.068809509277344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance f66dc876-aae4-4e20-8b96-c47a8e3dff60 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e21dec3d-4aa8-4066-99c8-2782c41f913e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fdf4097a-b7f0-4802-8abc-2583acd8ab84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 05:59:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.343s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:59:05 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance destroyed successfully.
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'resources' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8420ab57-d9, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=49426b5e-d4de-4e59-84e5-2de366c13076) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:05 user nova-compute[75648]: INFO os_vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9')
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:05 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac294ec9-60a6-423d-8748-209d95223caa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:59:05 user nova-compute[75648]: No targets found.
Nov 15 05:59:05 user nova-compute[75648]: iSNS:
Nov 15 05:59:05 user nova-compute[75648]: No targets found.
Nov 15 05:59:05 user nova-compute[75648]: STATIC:
Nov 15 05:59:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 05:59:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:59:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:59:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 05:59:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:59:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:59:05 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb
Nov 15 05:59:05 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:59:05 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:59:05 user nova-compute[75648]: FIRMWARE:
Nov 15 05:59:05 user nova-compute[75648]: No targets found.
Nov 15 05:59:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:59:05 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:59:05 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2c511b-6c6c-4e31-8022-3cf00da37f06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f491f230-e70b-4bd0-97ce-af0fe5d2d147]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:05 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:05 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:05 user nova-compute[75648]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:05 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ba560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb2c982-8f80-4e6f-a0a3-f53cdca39b4c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4870205-a822-47a1-ab9b-444d6d592d2b]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[08477753-0f98-4d26-bab1-41df27906942]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c69641-0b3a-405a-8385-9e5b5b472130]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b783b89-9dda-4297-837f-789ff5dce143]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e8bfd6-9d64-42a6-a331-ef26eba29076]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]
Nov 15 05:59:05 user nova-compute[75648]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.
Nov 15 05:59:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d654965-2afd-467c-b276-05e20de0b198]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== disconnect_volume: return (273ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start _get_guest_xml network_info=[{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '4b4c3b67-ed08-495a-b1e7-ebcdb01807b6', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '8e6eb152-51f0-41a8-9d32-2b1e3831582b', 'attached_at': '', 'detached_at': '', 'volume_id': '7e561568-26fb-4b2c-8e82-78ef935f4202', 'serial': '7e561568-26fb-4b2c-8e82-78ef935f4202'}, 'delete_on_termination': False, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:59:05 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:05 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:05 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:05 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44dd84e-5666-4827-b8ba-eaea9b7711bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:59:05 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a17e7fd-b51d-4c25-912c-37628129671b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202] added
Nov 15 05:59:05 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[175b1326-2594-4c0b-8b82-48c96789d959]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c584eb-6438-43dc-bd04-669f30025998]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWKuoMbT {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GWKuoMbT" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ebe671-595a-47e9-b335-4aab9b6c811e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GWKuoMbT'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c80ae7b-4024-4c97-8908-91a24e9031dc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6924b6f3-7ff1-44a9-9998-04bc788436f0]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:06 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:06 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bad21c-ee1f-4092-8f31-af4c7f449890]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]
Nov 15 05:59:06 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.
Nov 15 05:59:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[38075f4f-43a6-4d2c-ab2b-20c46b1134d2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a6b169-7e26-450c-9a15-bf72b9911610]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:06 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:06 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:06 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:06 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:06 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ba2065-9334-4659-9b3c-7104d508921f]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:59:06 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23630346339376239', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630346339376239', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:59:07 user nova-compute[75648]:   <uuid>8e6eb152-51f0-41a8-9d32-2b1e3831582b</uuid>
Nov 15 05:59:07 user nova-compute[75648]:   <name>instance-0000002b</name>
Nov 15 05:59:07 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:59:07 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:59:07 user nova-compute[75648]:   <metadata>
Nov 15 05:59:07 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:59:07 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:59:07 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeTestJSON-server-2058775542</nova:name>
Nov 15 05:59:07 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:59:05</nova:creationTime>
Nov 15 05:59:07 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:59:07 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:59:07 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:59:07 user nova-compute[75648]:       <nova:owner>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:user uuid="5fdcc2d55067412ba64925df1b9ef0e5">tempest-AttachVolumeTestJSON-1331007260-project-member</nova:user>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:project uuid="eb230cb5a30941d5b1901713c9082bfa">tempest-AttachVolumeTestJSON-1331007260</nova:project>
Nov 15 05:59:07 user nova-compute[75648]:       </nova:owner>
Nov 15 05:59:07 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:59:07 user nova-compute[75648]:       <nova:ports>
Nov 15 05:59:07 user nova-compute[75648]:         <nova:port uuid="8420ab57-d939-403c-8051-094cc2dc2e76">
Nov 15 05:59:07 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:59:07 user nova-compute[75648]:         </nova:port>
Nov 15 05:59:07 user nova-compute[75648]:       </nova:ports>
Nov 15 05:59:07 user nova-compute[75648]:     </nova:instance>
Nov 15 05:59:07 user nova-compute[75648]:   </metadata>
Nov 15 05:59:07 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:59:07 user nova-compute[75648]:     <system>
Nov 15 05:59:07 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:59:07 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:59:07 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:59:07 user nova-compute[75648]:       <entry name="serial">8e6eb152-51f0-41a8-9d32-2b1e3831582b</entry>
Nov 15 05:59:07 user nova-compute[75648]:       <entry name="uuid">8e6eb152-51f0-41a8-9d32-2b1e3831582b</entry>
Nov 15 05:59:07 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:59:07 user nova-compute[75648]:     </system>
Nov 15 05:59:07 user nova-compute[75648]:   </sysinfo>
Nov 15 05:59:07 user nova-compute[75648]:   <os>
Nov 15 05:59:07 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:59:07 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:59:07 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:59:07 user nova-compute[75648]:   </os>
Nov 15 05:59:07 user nova-compute[75648]:   <features>
Nov 15 05:59:07 user nova-compute[75648]:     <acpi/>
Nov 15 05:59:07 user nova-compute[75648]:     <apic/>
Nov 15 05:59:07 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:59:07 user nova-compute[75648]:   </features>
Nov 15 05:59:07 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:59:07 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:59:07 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:59:07 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:59:07 user nova-compute[75648]:   </clock>
Nov 15 05:59:07 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:59:07 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:59:07 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:59:07 user nova-compute[75648]:   </cpu>
Nov 15 05:59:07 user nova-compute[75648]:   <devices>
Nov 15 05:59:07 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:59:07 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:59:07 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk"/>
Nov 15 05:59:07 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:59:07 user nova-compute[75648]:     </disk>
Nov 15 05:59:07 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 05:59:07 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:07 user nova-compute[75648]:       <source dev="/dev/sdc"/>
Nov 15 05:59:07 user nova-compute[75648]:       <target dev="vdb" bus="virtio"/>
Nov 15 05:59:07 user nova-compute[75648]:       <serial>7e561568-26fb-4b2c-8e82-78ef935f4202</serial>
Nov 15 05:59:07 user nova-compute[75648]:     </disk>
Nov 15 05:59:07 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:59:07 user nova-compute[75648]:       <mac address="fa:16:3e:09:b5:d1"/>
Nov 15 05:59:07 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:59:07 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:59:07 user nova-compute[75648]:       <target dev="tap8420ab57-d9"/>
Nov 15 05:59:07 user nova-compute[75648]:     </interface>
Nov 15 05:59:07 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:59:07 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/console.log" append="off"/>
Nov 15 05:59:07 user nova-compute[75648]:     </serial>
Nov 15 05:59:07 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:59:07 user nova-compute[75648]:     <video>
Nov 15 05:59:07 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:59:07 user nova-compute[75648]:     </video>
Nov 15 05:59:07 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:59:07 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:59:07 user nova-compute[75648]:     </rng>
Nov 15 05:59:07 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:59:07 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:59:07 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:59:07 user nova-compute[75648]:     </memballoon>
Nov 15 05:59:07 user nova-compute[75648]:   </devices>
Nov 15 05:59:07 user nova-compute[75648]: </domain>
Nov 15 05:59:07 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Cannot resize image /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'migration_context' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.objects.base [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:57:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG os_vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a358a64-3f7f-5431-9a1a-990000365f49', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8420ab57-d9, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8420ab57-d9, col_values=(('qos', UUID('48ba7398-e477-47c7-84d5-f4d7d3c72c6e')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8420ab57-d9, col_values=(('external_ids', {'iface-id': '8420ab57-d939-403c-8051-094cc2dc2e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:b5:d1', 'vm-uuid': '8e6eb152-51f0-41a8-9d32-2b1e3831582b'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:59:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:07 user nova-compute[75648]: INFO os_vif [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9')
Nov 15 05:59:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-7882bb33-d0d8-43b2-b320-19940fb272c3 req-a242485f-b399-4f1a-a297-e18be0acc309 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7882bb33-d0d8-43b2-b320-19940fb272c3 req-a242485f-b399-4f1a-a297-e18be0acc309 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7882bb33-d0d8-43b2-b320-19940fb272c3 req-a242485f-b399-4f1a-a297-e18be0acc309 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7882bb33-d0d8-43b2-b320-19940fb272c3 req-a242485f-b399-4f1a-a297-e18be0acc309 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG nova.compute.manager [req-7882bb33-d0d8-43b2-b320-19940fb272c3 req-a242485f-b399-4f1a-a297-e18be0acc309 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:59:09 user nova-compute[75648]: WARNING nova.compute.manager [req-7882bb33-d0d8-43b2-b320-19940fb272c3 req-a242485f-b399-4f1a-a297-e18be0acc309 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state stopped and task_state powering-on.
Nov 15 05:59:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:59:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance rebooted successfully.
Nov 15 05:59:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-5af8484a-27f3-4f4a-a305-f24f68a9f7b9 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:59:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ea5d9c-4748-49b2-9887-d0282fe79da0 req-b05abf4b-6c2e-448b-a576-4757a674b4f9 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ea5d9c-4748-49b2-9887-d0282fe79da0 req-b05abf4b-6c2e-448b-a576-4757a674b4f9 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ea5d9c-4748-49b2-9887-d0282fe79da0 req-b05abf4b-6c2e-448b-a576-4757a674b4f9 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d8ea5d9c-4748-49b2-9887-d0282fe79da0 req-b05abf4b-6c2e-448b-a576-4757a674b4f9 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-d8ea5d9c-4748-49b2-9887-d0282fe79da0 req-b05abf4b-6c2e-448b-a576-4757a674b4f9 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:59:11 user nova-compute[75648]: WARNING nova.compute.manager [req-d8ea5d9c-4748-49b2-9887-d0282fe79da0 req-b05abf4b-6c2e-448b-a576-4757a674b4f9 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state active and task_state None.
Nov 15 05:59:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:16 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e is timed out.
Nov 15 05:59:16 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config.
Nov 15 05:59:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dwrYQoNW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:16 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51142e4-774c-41dd-a0b5-9dce6070c758]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 05:59:16 user nova-compute[75648]: No targets found.
Nov 15 05:59:16 user nova-compute[75648]: iSNS:
Nov 15 05:59:16 user nova-compute[75648]: No targets found.
Nov 15 05:59:16 user nova-compute[75648]: STATIC:
Nov 15 05:59:16 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 05:59:16 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:59:16 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:59:16 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 05:59:16 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:59:16 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:59:16 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb
Nov 15 05:59:16 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 05:59:16 user nova-compute[75648]:                 Iface Name: default
Nov 15 05:59:16 user nova-compute[75648]: FIRMWARE:
Nov 15 05:59:16 user nova-compute[75648]: No targets found.
Nov 15 05:59:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 05:59:16 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 05:59:16 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6c8099-828f-4834-adee-2dde30d00ad4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eba92c-bb8d-4af4-bcd8-560320d3cc4a]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:16 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:16 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:16 user nova-compute[75648]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb (non-flash)
Nov 15 05:59:16 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e841d870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a6573-428e-449a-b4a8-a55ab4188d2d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[269aa711-4acd-4d5a-86f3-a24b5ca52a3a]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ed0053-a266-4bfd-82c7-f712fad39536]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e95958e-d700-4b30-af98-c779323b403c]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc54f94-31f5-4dc4-9537-e2cdf6d1ee9a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f1c7318-6eeb-4d08-a2b4-216d3318fa6d]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260]
Nov 15 05:59:16 user nova-compute[75648]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb, portal: 172.16.0.220,3260] successful.
Nov 15 05:59:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3747730d-4fce-45cf-9372-edc07e60e6eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2161d2d-88b4-4d81-8421-5261c5214ef5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== disconnect_volume: return (308ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 05:59:17 user nova-compute[75648]: DEBUG nova.objects.instance [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-25e4c821-f221-4252-83c3-abf385afd1b5 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.607s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:18 user nova-compute[75648]: INFO nova.compute.manager [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Terminating instance
Nov 15 05:59:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-163ca578-53af-4231-8ae0-0badab74e471 req-c311e943-65ec-4177-ad6d-ab0bbcbc754f service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-vif-unplugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-163ca578-53af-4231-8ae0-0badab74e471 req-c311e943-65ec-4177-ad6d-ab0bbcbc754f service nova] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-163ca578-53af-4231-8ae0-0badab74e471 req-c311e943-65ec-4177-ad6d-ab0bbcbc754f service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-163ca578-53af-4231-8ae0-0badab74e471 req-c311e943-65ec-4177-ad6d-ab0bbcbc754f service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-163ca578-53af-4231-8ae0-0badab74e471 req-c311e943-65ec-4177-ad6d-ab0bbcbc754f service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] No waiting events found dispatching network-vif-unplugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.compute.manager [req-163ca578-53af-4231-8ae0-0badab74e471 req-c311e943-65ec-4177-ad6d-ab0bbcbc754f service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-vif-unplugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 05:59:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Instance destroyed successfully.
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lazy-loading 'resources' on Instance uuid f66dc876-aae4-4e20-8b96-c47a8e3dff60 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:38:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-91853311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-91853311',id=2,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:39:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c13f9a55b45f4f9992e2f86628b34982',ramdisk_id='',reservation_id='r-82iqqsrs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-893883912',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:40:48Z,user_data=None,user_id='47b4817a59584433a28790c3a16d0b5c',uuid=f66dc876-aae4-4e20-8b96-c47a8e3dff60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converting VIF {"id": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "address": "fa:16:3e:3a:cd:89", "network": {"id": "23b21354-2068-43d4-bf57-3fe34caf4478", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1478566925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c13f9a55b45f4f9992e2f86628b34982", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap589ad79a-ee", "ovs_interfaceid": "589ad79a-ee59-4272-ab7b-d00c3c8b7610", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG os_vif [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap589ad79a-ee, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c749b92-d4f4-4ab2-8210-97f2d4df9b5f) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:19 user nova-compute[75648]: INFO os_vif [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:cd:89,bridge_name='br-int',has_traffic_filtering=True,id=589ad79a-ee59-4272-ab7b-d00c3c8b7610,network=Network(23b21354-2068-43d4-bf57-3fe34caf4478),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap589ad79a-ee')
Nov 15 05:59:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Deleting instance files /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60_del
Nov 15 05:59:19 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Deletion of /opt/stack/data/nova/instances/f66dc876-aae4-4e20-8b96-c47a8e3dff60_del complete
Nov 15 05:59:19 user nova-compute[75648]: INFO nova.compute.manager [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 15 05:59:19 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 05:59:19 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:59:19 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Took 0.41 seconds to deallocate network for instance.
Nov 15 05:59:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-f0c794e1-445f-4474-915c-31264ba5d265 req-4a6b6d78-5eb1-44c6-9402-941f8c23658e service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-vif-deleted-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:20 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:59:20 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:59:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.240s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:20 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Deleted allocations for instance f66dc876-aae4-4e20-8b96-c47a8e3dff60
Nov 15 05:59:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2892f72f-a333-4399-9990-ea4558912871 tempest-ServerBootFromVolumeStableRescueTest-893883912 tempest-ServerBootFromVolumeStableRescueTest-893883912-project-member] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.684s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-8dfd7ad4-24f3-46f3-84fd-2092acf0fa01 req-c83bed3b-a519-4ba2-b82f-fa1167607006 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received event network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8dfd7ad4-24f3-46f3-84fd-2092acf0fa01 req-c83bed3b-a519-4ba2-b82f-fa1167607006 service nova] Acquiring lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8dfd7ad4-24f3-46f3-84fd-2092acf0fa01 req-c83bed3b-a519-4ba2-b82f-fa1167607006 service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8dfd7ad4-24f3-46f3-84fd-2092acf0fa01 req-c83bed3b-a519-4ba2-b82f-fa1167607006 service nova] Lock "f66dc876-aae4-4e20-8b96-c47a8e3dff60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:21 user nova-compute[75648]: DEBUG nova.compute.manager [req-8dfd7ad4-24f3-46f3-84fd-2092acf0fa01 req-c83bed3b-a519-4ba2-b82f-fa1167607006 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] No waiting events found dispatching network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:59:21 user nova-compute[75648]: WARNING nova.compute.manager [req-8dfd7ad4-24f3-46f3-84fd-2092acf0fa01 req-c83bed3b-a519-4ba2-b82f-fa1167607006 service nova] [instance: f66dc876-aae4-4e20-8b96-c47a8e3dff60] Received unexpected event network-vif-plugged-589ad79a-ee59-4272-ab7b-d00c3c8b7610 for instance with vm_state deleted and task_state None.
Nov 15 05:59:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-changed-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG nova.compute.manager [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Refreshing instance network info cache due to event network-changed-05d5edc1-714b-4a82-bcdc-54fab89f7843. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] Acquiring lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] Acquired lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Refreshing network info cache for port 05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updated VIF entry in instance network info cache for port 05d5edc1-714b-4a82-bcdc-54fab89f7843. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG nova.network.neutron [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updating instance_info_cache with network_info: [{"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:59:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a60a57d4-8bfc-4dc8-a3db-86bbc719c845 req-b18f5cc8-7796-40b4-9d3c-af66c7ffbe1c service nova] Releasing lock "refresh_cache-2026767b-71cf-48f6-8f2f-7d331bad9aeb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:59:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 05:59:32 user nova-compute[75648]: INFO nova.compute.claims [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Claim successful on node user
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lazy-loading 'flavor' on Instance uuid 2026767b-71cf-48f6-8f2f-7d331bad9aeb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:32 user nova-compute[75648]: INFO nova.compute.manager [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Attaching volume 2e694cc0-cd51-42cf-bd03-56124c806587 to /dev/vdb
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 05:59:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 05:59:32 user nova-compute[75648]: DEBUG os_brick.utils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[618a70b8-a21c-45ab-b973-648522beb105]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbe3032-09b5-46fb-8bd5-7ef13aab69a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6205c8ba-930e-407a-a7fb-650e2728dd9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c8055b-2d89-43c0-bf77-990d4f40d271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.policy [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f995cb1428a414d91dd043e1c53d130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06304608934649daab8dc8e603b9a446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:59:33 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1acc25-b089-41c6-b096-15a59e36b797]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG os_brick.utils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updating existing volume attachment record: 14f73b1c-3ce7-4b53-904e-3b2d15d4137c {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 05:59:33 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Creating image(s)
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "/opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk 1073741824" returned: 0 in 0.054s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Successfully created port: 91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.193s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Cannot resize image /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Ensure instance console log exists: /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Successfully updated port: 91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquired lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-changed-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Refreshing instance network info cache due to event network-changed-91befc9d-8f30-4e55-a8d1-133756c3a773. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] Acquiring lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updating instance_info_cache with network_info: [{"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Releasing lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Instance network_info: |[{"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] Acquired lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Refreshing network info cache for port 91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Start _get_guest_xml network_info=[{"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 05:59:34 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:59:34 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548025858',display_name='tempest-AttachVolumeNegativeTest-server-1548025858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548025858',id=46,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlqy9plOS6Q5M9dY6TF5tBpO2unzedVdsFz045vtODgaI1TMIvgNnEAukA6VBxB8P9C/ZSFvn786Rl0ocrZpk9X73B2+Z+iXN6tLpnh2vxhamXcj7GSGUSuP8oyLhriJA==',key_name='tempest-keypair-772132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-63dy7hrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] End _get_guest_xml xml=<domain type="kvm">
Nov 15 05:59:34 user nova-compute[75648]:   <uuid>6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb</uuid>
Nov 15 05:59:34 user nova-compute[75648]:   <name>instance-0000002e</name>
Nov 15 05:59:34 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 05:59:34 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 05:59:34 user nova-compute[75648]:   <metadata>
Nov 15 05:59:34 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 05:59:34 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 05:59:34 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1548025858</nova:name>
Nov 15 05:59:34 user nova-compute[75648]:       <nova:creationTime>2023-11-15 05:59:34</nova:creationTime>
Nov 15 05:59:34 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 05:59:34 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 05:59:34 user nova-compute[75648]:       </nova:flavor>
Nov 15 05:59:34 user nova-compute[75648]:       <nova:owner>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:user uuid="8f995cb1428a414d91dd043e1c53d130">tempest-AttachVolumeNegativeTest-2114996187-project-member</nova:user>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:project uuid="06304608934649daab8dc8e603b9a446">tempest-AttachVolumeNegativeTest-2114996187</nova:project>
Nov 15 05:59:34 user nova-compute[75648]:       </nova:owner>
Nov 15 05:59:34 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 05:59:34 user nova-compute[75648]:       <nova:ports>
Nov 15 05:59:34 user nova-compute[75648]:         <nova:port uuid="91befc9d-8f30-4e55-a8d1-133756c3a773">
Nov 15 05:59:34 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 05:59:34 user nova-compute[75648]:         </nova:port>
Nov 15 05:59:34 user nova-compute[75648]:       </nova:ports>
Nov 15 05:59:34 user nova-compute[75648]:     </nova:instance>
Nov 15 05:59:34 user nova-compute[75648]:   </metadata>
Nov 15 05:59:34 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 05:59:34 user nova-compute[75648]:     <system>
Nov 15 05:59:34 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 05:59:34 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 05:59:34 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 05:59:34 user nova-compute[75648]:       <entry name="serial">6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb</entry>
Nov 15 05:59:34 user nova-compute[75648]:       <entry name="uuid">6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb</entry>
Nov 15 05:59:34 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 05:59:34 user nova-compute[75648]:     </system>
Nov 15 05:59:34 user nova-compute[75648]:   </sysinfo>
Nov 15 05:59:34 user nova-compute[75648]:   <os>
Nov 15 05:59:34 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 05:59:34 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 05:59:34 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 05:59:34 user nova-compute[75648]:   </os>
Nov 15 05:59:34 user nova-compute[75648]:   <features>
Nov 15 05:59:34 user nova-compute[75648]:     <acpi/>
Nov 15 05:59:34 user nova-compute[75648]:     <apic/>
Nov 15 05:59:34 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 05:59:34 user nova-compute[75648]:   </features>
Nov 15 05:59:34 user nova-compute[75648]:   <clock offset="utc">
Nov 15 05:59:34 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 05:59:34 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 05:59:34 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 05:59:34 user nova-compute[75648]:   </clock>
Nov 15 05:59:34 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 05:59:34 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 05:59:34 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 05:59:34 user nova-compute[75648]:   </cpu>
Nov 15 05:59:34 user nova-compute[75648]:   <devices>
Nov 15 05:59:34 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 05:59:34 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 05:59:34 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk"/>
Nov 15 05:59:34 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 05:59:34 user nova-compute[75648]:     </disk>
Nov 15 05:59:34 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 05:59:34 user nova-compute[75648]:       <mac address="fa:16:3e:26:79:4b"/>
Nov 15 05:59:34 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:59:34 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 05:59:34 user nova-compute[75648]:       <target dev="tap91befc9d-8f"/>
Nov 15 05:59:34 user nova-compute[75648]:     </interface>
Nov 15 05:59:34 user nova-compute[75648]:     <serial type="pty">
Nov 15 05:59:34 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/console.log" append="off"/>
Nov 15 05:59:34 user nova-compute[75648]:     </serial>
Nov 15 05:59:34 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 05:59:34 user nova-compute[75648]:     <video>
Nov 15 05:59:34 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 05:59:34 user nova-compute[75648]:     </video>
Nov 15 05:59:34 user nova-compute[75648]:     <rng model="virtio">
Nov 15 05:59:34 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 05:59:34 user nova-compute[75648]:     </rng>
Nov 15 05:59:34 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 05:59:34 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 05:59:34 user nova-compute[75648]:       <stats period="10"/>
Nov 15 05:59:34 user nova-compute[75648]:     </memballoon>
Nov 15 05:59:34 user nova-compute[75648]:   </devices>
Nov 15 05:59:34 user nova-compute[75648]: </domain>
Nov 15 05:59:34 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548025858',display_name='tempest-AttachVolumeNegativeTest-server-1548025858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548025858',id=46,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlqy9plOS6Q5M9dY6TF5tBpO2unzedVdsFz045vtODgaI1TMIvgNnEAukA6VBxB8P9C/ZSFvn786Rl0ocrZpk9X73B2+Z+iXN6tLpnh2vxhamXcj7GSGUSuP8oyLhriJA==',key_name='tempest-keypair-772132',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-63dy7hrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T05:59:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG os_vif [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15f0be5b-44a5-509b-89f1-cbb31f382bcb', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91befc9d-8f, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91befc9d-8f, col_values=(('qos', UUID('02e9cc6e-4a32-4f5f-9e7f-8ee243a0e16d')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91befc9d-8f, col_values=(('external_ids', {'iface-id': '91befc9d-8f30-4e55-a8d1-133756c3a773', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:79:4b', 'vm-uuid': '6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:34 user nova-compute[75648]: INFO os_vif [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f')
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:59:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:26:79:4b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:59:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updated VIF entry in instance network info cache for port 91befc9d-8f30-4e55-a8d1-133756c3a773. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 05:59:35 user nova-compute[75648]: DEBUG nova.network.neutron [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updating instance_info_cache with network_info: [{"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 05:59:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3ed12193-68b2-437a-b608-e2a323c45fe4 req-d12fcd47-1824-488a-ae3e-0c10b7d6e7b6 service nova] Releasing lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-653323a6-09cd-426c-887e-69f9f3320664 req-9135463d-bb45-4d6e-9746-4d54b34013a0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-653323a6-09cd-426c-887e-69f9f3320664 req-9135463d-bb45-4d6e-9746-4d54b34013a0 service nova] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-653323a6-09cd-426c-887e-69f9f3320664 req-9135463d-bb45-4d6e-9746-4d54b34013a0 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-653323a6-09cd-426c-887e-69f9f3320664 req-9135463d-bb45-4d6e-9746-4d54b34013a0 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-653323a6-09cd-426c-887e-69f9f3320664 req-9135463d-bb45-4d6e-9746-4d54b34013a0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] No waiting events found dispatching network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:59:36 user nova-compute[75648]: WARNING nova.compute.manager [req-653323a6-09cd-426c-887e-69f9f3320664 req-9135463d-bb45-4d6e-9746-4d54b34013a0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received unexpected event network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 for instance with vm_state building and task_state spawning.
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'auZfHkJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:37 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:37 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:37 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11853d3-d9e7-48a1-9456-86592afbeeda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:59:37 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[529f025d-dd73-4db6-924c-190dc3345222]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587] added
Nov 15 05:59:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f853d66-970a-4fa3-844f-41b8349f8c32]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3b3349-372b-4702-98e5-19515e776d65]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v auZfHkJc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v auZfHkJc" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ead527-5d29-4802-a24a-6d0e3698d89a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'auZfHkJc'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c343014-6041-4b9e-9ac4-402dc611a406]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbbb968-6747-4ebb-99ce-f790add1eeb2]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae95216e-d1d8-42b8-8b46-f5c49dec2f50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260]
Nov 15 05:59:37 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260] successful.
Nov 15 05:59:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c888de23-4478-480b-b891-d8f47063fdd7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4128fc6-4d84-4e2b-adf9-3df39571aaf4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 05:59:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95c2493-00f5-4017-a2c2-882a89d7933b]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:59:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'auZfHkJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 05:59:38 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Instance spawned successfully.
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-69e23077-75ed-4db5-84c8-6b8ec58ba251 req-1c14bfc9-efe8-4698-aebb-4e6f5c7095e3 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69e23077-75ed-4db5-84c8-6b8ec58ba251 req-1c14bfc9-efe8-4698-aebb-4e6f5c7095e3 service nova] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69e23077-75ed-4db5-84c8-6b8ec58ba251 req-1c14bfc9-efe8-4698-aebb-4e6f5c7095e3 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69e23077-75ed-4db5-84c8-6b8ec58ba251 req-1c14bfc9-efe8-4698-aebb-4e6f5c7095e3 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-69e23077-75ed-4db5-84c8-6b8ec58ba251 req-1c14bfc9-efe8-4698-aebb-4e6f5c7095e3 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] No waiting events found dispatching network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 05:59:38 user nova-compute[75648]: WARNING nova.compute.manager [req-69e23077-75ed-4db5-84c8-6b8ec58ba251 req-1c14bfc9-efe8-4698-aebb-4e6f5c7095e3 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received unexpected event network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 for instance with vm_state building and task_state spawning.
Nov 15 05:59:38 user nova-compute[75648]: INFO nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 05:59:38 user nova-compute[75648]: INFO nova.compute.manager [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Took 6.40 seconds to build instance.
Nov 15 05:59:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cd55faac-ef81-4b7a-9590-925b5a4e0e48 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.715s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23763656666663431', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763656666663431', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lazy-loading 'flavor' on Instance uuid 2026767b-71cf-48f6-8f2f-7d331bad9aeb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:59:38 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:38 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 05:59:38 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:59:38 user nova-compute[75648]:   <serial>2e694cc0-cd51-42cf-bd03-56124c806587</serial>
Nov 15 05:59:38 user nova-compute[75648]: </disk>
Nov 15 05:59:38 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:59:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:59:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:59:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] No VIF found with MAC fa:16:3e:f6:47:06, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:59:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e664acf-18ad-4a0d-ade2-2871db52de09 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.522s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:42 user nova-compute[75648]: INFO nova.compute.manager [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Detaching volume 2e694cc0-cd51-42cf-bd03-56124c806587
Nov 15 05:59:42 user nova-compute[75648]: INFO nova.virt.block_device [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Attempting to driver detach volume 2e694cc0-cd51-42cf-bd03-56124c806587 from mountpoint /dev/vdb
Nov 15 05:59:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Attempting to detach device vdb from instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:59:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:59:42 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:42 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 05:59:42 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:59:42 user nova-compute[75648]:   <serial>2e694cc0-cd51-42cf-bd03-56124c806587</serial>
Nov 15 05:59:42 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:59:42 user nova-compute[75648]: </disk>
Nov 15 05:59:42 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:59:42 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Successfully detached device vdb from instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb from the persistent domain config.
Nov 15 05:59:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:59:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:59:42 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:42 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 05:59:42 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:59:42 user nova-compute[75648]:   <serial>2e694cc0-cd51-42cf-bd03-56124c806587</serial>
Nov 15 05:59:42 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:59:42 user nova-compute[75648]: </disk>
Nov 15 05:59:42 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:59:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:59:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:47 user nova-compute[75648]: INFO nova.compute.manager [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attaching volume 7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b to /dev/vdb
Nov 15 05:59:47 user nova-compute[75648]: DEBUG os_brick.utils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[12da553c-54f4-4b66-a9bc-2cd98f41582f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc72094b-7974-412f-a437-6318a95e4074]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe06fa-109f-44c6-a793-e3606cb57e60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[68df0541-d64c-4347-b1f1-837bc28cd261]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:47 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 05:59:48 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 05:59:48 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cb6ff0-2486-4e90-8698-06b9a09d358c]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG os_brick.utils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating existing volume attachment record: 7a9d7473-98a9-4231-a572-8d1864d8a441 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 05:59:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzDwGMlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 05:59:52 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:52 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 05:59:52 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[004acac7-feba-44c8-8569-e922418e9962]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 05:59:52 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a6a737-c484-4cd3-ad48-1df1fc4373cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b] added
Nov 15 05:59:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c59051-6002-4cda-a678-fabc1349490e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3516875-f11e-47c6-8aca-d83bb3980d0d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzDwGMlC {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kzDwGMlC" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[840e8ff4-ed5b-49d0-b270-17425f6d339b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kzDwGMlC'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b853be78-9329-43dc-bd02-da8c667bd5f0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6d408c-7bde-41d5-8f81-ef518f114c3d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2209c64c-fb35-4b59-be90-5b4ca8bcfa74]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260]
Nov 15 05:59:52 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260] successful.
Nov 15 05:59:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[00825bf7-1468-4043-bc1a-55def9c65daf]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c2dea3-ddcc-4884-baa4-9b1207fbcb96]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 05:59:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 05:59:52 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 05:59:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb3cd477-650a-4962-ae34-7a124b36cda0]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 05:59:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzDwGMlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26162643430653465', 'path': '/dev/sde'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26162643430653465', 'path': '/dev/sde'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 05:59:53 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:53 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:59:53 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:59:53 user nova-compute[75648]:   <serial>7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b</serial>
Nov 15 05:59:53 user nova-compute[75648]: </disk>
Nov 15 05:59:53 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 05:59:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:59:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 05:59:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No VIF found with MAC fa:16:3e:09:c2:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 05:59:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4fb43569-aa59-41bf-867b-0a472183979f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.467s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 05:59:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 05:59:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 05:59:56 user nova-compute[75648]: INFO nova.compute.manager [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Detaching volume 7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b
Nov 15 05:59:57 user nova-compute[75648]: INFO nova.virt.block_device [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attempting to driver detach volume 7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b from mountpoint /dev/vdb
Nov 15 05:59:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Attempting to detach device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 05:59:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:59:57 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:57 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:59:57 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:59:57 user nova-compute[75648]:   <serial>7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b</serial>
Nov 15 05:59:57 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:59:57 user nova-compute[75648]: </disk>
Nov 15 05:59:57 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:59:57 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config.
Nov 15 05:59:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 05:59:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 05:59:57 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 05:59:57 user nova-compute[75648]:   <source dev="/dev/sde"/>
Nov 15 05:59:57 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 05:59:57 user nova-compute[75648]:   <serial>7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b</serial>
Nov 15 05:59:57 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 05:59:57 user nova-compute[75648]: </disk>
Nov 15 05:59:57 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 05:59:57 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 05:59:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 05:59:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:01 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:02 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb is timed out.
Nov 15 06:00:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Successfully detached device vdb from instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb from the live domain config.
Nov 15 06:00:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'auZfHkJc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:02 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e6b694-925f-4a21-9923-91999b34d716]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:00:02 user nova-compute[75648]: No targets found.
Nov 15 06:00:02 user nova-compute[75648]: iSNS:
Nov 15 06:00:02 user nova-compute[75648]: No targets found.
Nov 15 06:00:02 user nova-compute[75648]: STATIC:
Nov 15 06:00:02 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 06:00:02 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:02 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:02 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b
Nov 15 06:00:02 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:02 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:02 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 06:00:02 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:02 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:02 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587
Nov 15 06:00:02 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:02 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:02 user nova-compute[75648]: FIRMWARE:
Nov 15 06:00:02 user nova-compute[75648]: No targets found.
Nov 15 06:00:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:00:02 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:00:02 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d13599-cef0-4b0a-9289-925422a67946]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f42b0e5-1c04-42d0-bba1-384b656fb374]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 06:00:02 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:02 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 06:00:02 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 06:00:02 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:02 user nova-compute[75648]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 (non-flash)
Nov 15 06:00:02 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e867d6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae9359b-3887-45ac-b530-05527e806ceb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf43b317-fd81-40e5-bd80-ad047edec88c]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5cf90f-8824-4011-b304-e9a89b67a114]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2985dcf-d955-4e40-bd0c-8d81d0d01730]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.040s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f901dd0-b38b-4b79-ae48-da00afdf927c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --logout" returned: 0 in 0.192s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aa118c-cecf-4380-87e3-d1080a3e7b16]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260]
Nov 15 06:00:03 user nova-compute[75648]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587, portal: 172.16.0.220,3260] successful.
Nov 15 06:00:03 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e694cc0-cd51-42cf-bd03-56124c806587 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8095fb0-09fb-42e6-8323-cd0a283c18d7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.465s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] <== disconnect_volume: return (466ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lazy-loading 'flavor' on Instance uuid 2026767b-71cf-48f6-8f2f-7d331bad9aeb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e2969102-04b8-4867-abab-7c0e258a83cd tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:04 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:00:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:00:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:00:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:00:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:00:06 user nova-compute[75648]: INFO nova.compute.claims [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Claim successful on node user
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.556s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 06:00:06 user nova-compute[75648]: DEBUG nova.network.neutron [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 06:00:06 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.policy [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d61be40c2864afc99cd689efdb30308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06bd3ce1caf14075b2d936ac45b143f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 06:00:07 user nova-compute[75648]: INFO nova.virt.block_device [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Booting with volume b99c4e57-182b-402d-8892-faf894405f79 at /dev/vda
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG os_brick.utils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[085b372f-014a-4aef-8454-333540e9355c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:00:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8132MB free_disk=25.154476165771484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d2620c-7008-43a8-90c0-be1d2116e524]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[54946bf3-3d33-4c10-920c-4bcb41857740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5003be2-1162-48bc-a3cb-47a6080b5b6f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.network.neutron [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Successfully created port: 0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:00:07 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[af332925-71d6-4dc2-a12d-191643aaf9c8]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG os_brick.utils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== get_connector_properties: return (503ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating existing volume attachment record: 60134c9f-9800-462a-a23c-f6dda23f393e {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e21dec3d-4aa8-4066-99c8-2782c41f913e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance fdf4097a-b7f0-4802-8abc-2583acd8ab84 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:00:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Successfully updated port: 0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-changed-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Refreshing instance network info cache due to event network-changed-0a05de2b-0610-4a54-9a2b-7b80f5c5d399. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Refreshing network info cache for port 0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c0c3f6ea-101a-48f1-a3a2-6c819eabe4b0 req-53311249-895a-4e00-8c7b-c5c77222696e service nova] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance network_info: |[{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:09 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:00:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing instance network info cache due to event network-changed-9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] Acquiring lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] Acquired lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG nova.network.neutron [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Refreshing network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:10 user nova-compute[75648]: INFO nova.compute.manager [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Terminating instance
Nov 15 06:00:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-15b34884-342a-4f19-89b5-f3f318a8f8c7 req-1770305b-c7d6-44e5-8914-14c7ad608aba service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-unplugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-15b34884-342a-4f19-89b5-f3f318a8f8c7 req-1770305b-c7d6-44e5-8914-14c7ad608aba service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-15b34884-342a-4f19-89b5-f3f318a8f8c7 req-1770305b-c7d6-44e5-8914-14c7ad608aba service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-15b34884-342a-4f19-89b5-f3f318a8f8c7 req-1770305b-c7d6-44e5-8914-14c7ad608aba service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-15b34884-342a-4f19-89b5-f3f318a8f8c7 req-1770305b-c7d6-44e5-8914-14c7ad608aba service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-unplugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-15b34884-342a-4f19-89b5-f3f318a8f8c7 req-1770305b-c7d6-44e5-8914-14c7ad608aba service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-unplugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Instance destroyed successfully.
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.objects.instance [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lazy-loading 'resources' on Instance uuid fdf4097a-b7f0-4802-8abc-2583acd8ab84 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-15T05:54:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1341763353',display_name='tempest-TestShelveInstance-server-1341763353',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1341763353',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHq2HhlG5b9x0nJmzt8cepOedKjawpG0QLkzmrdDlBep6Zc8jxWnSTc5rjLZuhnzrpPjTv2R+//hXw0zmXOJ388Xh8J0UmhI83aCpX0khAF+L+9zAZSkhoniuwIXfVD08A==',key_name='tempest-TestShelveInstance-1044638316',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:58:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bb07fa691bf94a7f8a85cd8edf71b795',ramdisk_id='',reservation_id='r-2r401zi9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-812316993',owner_user_name='tempest-TestShelveInstance-812316993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:58:31Z,user_data=None,user_id='eb4b0c67e9cd4a3eb697f4d2b1668fb6',uuid=fdf4097a-b7f0-4802-8abc-2583acd8ab84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converting VIF {"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_vif [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9de3a7e3-31, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=757e7dae-dbc1-42a7-ae93-2d400b023eac) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:11 user nova-compute[75648]: INFO os_vif [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:53:8c,bridge_name='br-int',has_traffic_filtering=True,id=9de3a7e3-3152-4276-bd9e-d3ddfcac0696,network=Network(150db143-f25f-4ad1-89ef-916c2e10c41e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9de3a7e3-31')
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bgQmtAJM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:11 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[af89dde9-bd79-4628-81a1-7ad1bb49d2f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:00:11 user nova-compute[75648]: No targets found.
Nov 15 06:00:11 user nova-compute[75648]: iSNS:
Nov 15 06:00:11 user nova-compute[75648]: No targets found.
Nov 15 06:00:11 user nova-compute[75648]: STATIC:
Nov 15 06:00:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 06:00:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b
Nov 15 06:00:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:11 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715
Nov 15 06:00:11 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:11 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:11 user nova-compute[75648]: FIRMWARE:
Nov 15 06:00:11 user nova-compute[75648]: No targets found.
Nov 15 06:00:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:00:11 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:00:11 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa175c5-0dbf-4d32-aede-e31fb9230f99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ebd970-4956-4b2f-a0c8-1a3561bbc01f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 06:00:11 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:11 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 (non-flash)
Nov 15 06:00:11 user nova-compute[75648]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:11 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8158e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.network.neutron [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updated VIF entry in instance network info cache for port 9de3a7e3-3152-4276-bd9e-d3ddfcac0696. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.network.neutron [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [{"id": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "address": "fa:16:3e:09:53:8c", "network": {"id": "150db143-f25f-4ad1-89ef-916c2e10c41e", "bridge": "br-int", "label": "tempest-TestShelveInstance-1435460161-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bb07fa691bf94a7f8a85cd8edf71b795", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9de3a7e3-31", "ovs_interfaceid": "9de3a7e3-3152-4276-bd9e-d3ddfcac0696", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70f68fc-76fe-40cf-8e50-e122b429ddcc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8674be50-e4a0-40d3-9504-152c2c273a63 req-629d7980-3d70-4592-a1e5-89fdb405666a service nova] Releasing lock "refresh_cache-fdf4097a-b7f0-4802-8abc-2583acd8ab84" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797d8b4-19c7-4d44-b465-6f58b2ba924a]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3332c71-9451-4523-af63-7b1936ba3364]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6ba79d-b7cc-4bc7-9851-4f6a8d6569ae]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[345e8f7d-2522-4d12-a58b-db999ee2abb7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[30898714-db9b-4091-aae3-12905cb9fc6e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260]
Nov 15 06:00:11 user nova-compute[75648]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715, portal: 172.16.0.220,3260] successful.
Nov 15 06:00:11 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1a179055-9e6f-4f14-9c27-dafa5e297715 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ed01f4-5b24-4c80-8463-4ade4dc934b2]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] <== disconnect_volume: return (319ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:00:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Deleting instance files /opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84_del
Nov 15 06:00:11 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Deletion of /opt/stack/data/nova/instances/fdf4097a-b7f0-4802-8abc-2583acd8ab84_del complete
Nov 15 06:00:11 user nova-compute[75648]: INFO nova.compute.manager [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 15 06:00:11 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:00:11 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 06:00:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Creating image(s)
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Ensure instance console log exists: /opt/stack/data/nova/instances/23e250a1-2c65-4ba1-b8d8-09cf4334ad44/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Start _get_guest_xml network_info=[{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '60134c9f-9800-462a-a23c-f6dda23f393e', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '23e250a1-2c65-4ba1-b8d8-09cf4334ad44', 'attached_at': '', 'detached_at': '', 'volume_id': 'b99c4e57-182b-402d-8892-faf894405f79', 'serial': 'b99c4e57-182b-402d-8892-faf894405f79'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:00:12 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:00:12 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:12 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:12 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:00:12 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Took 0.53 seconds to deallocate network for instance.
Nov 15 06:00:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-cf7d31e6-58ac-42b4-b2c5-2dd7c4560a01 req-cfaeeed9-70da-4ebc-b3dd-0809ca1a6e52 service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-deleted-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e670d8b1-f0e3-44c7-b0ed-114a55860db9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:00:12 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[44720e33-5b39-41cf-b319-c1b7cc9d809b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79] added
Nov 15 06:00:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6cdb1c-feac-40f4-b45f-af33e26c5472]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7c50d3-df4f-4d71-90b3-8ade68474787]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHMyPpVI {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHMyPpVI" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa282a-aeee-4e7c-9823-ff88dec46028]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JHMyPpVI'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d4a0d-622e-453f-848f-eb2b3c5426bd]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5f9912-58a4-48e2-8d06-ceecfb0889b8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:12 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:12 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d12a9e-0d27-49b2-b8fa-3cd56d7c0d46]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]
Nov 15 06:00:12 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.
Nov 15 06:00:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd23d3b1-0796-4b0d-987e-d427ad0bdf93]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0977fa79-78a0-4622-9358-d0bd374da973]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:12 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:12 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:12 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:12 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:12 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[646f6f71-faf6-4fdc-89d2-fab94f602bd6]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:00:12 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-170f72e1-8dc4-4e8a-8792-51242ef0b069 req-0c727be3-05a7-41e0-8621-bf2fe1a2b25d service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-170f72e1-8dc4-4e8a-8792-51242ef0b069 req-0c727be3-05a7-41e0-8621-bf2fe1a2b25d service nova] Acquiring lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-170f72e1-8dc4-4e8a-8792-51242ef0b069 req-0c727be3-05a7-41e0-8621-bf2fe1a2b25d service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-170f72e1-8dc4-4e8a-8792-51242ef0b069 req-0c727be3-05a7-41e0-8621-bf2fe1a2b25d service nova] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-170f72e1-8dc4-4e8a-8792-51242ef0b069 req-0c727be3-05a7-41e0-8621-bf2fe1a2b25d service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] No waiting events found dispatching network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:00:13 user nova-compute[75648]: WARNING nova.compute.manager [req-170f72e1-8dc4-4e8a-8792-51242ef0b069 req-0c727be3-05a7-41e0-8621-bf2fe1a2b25d service nova] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Received unexpected event network-vif-plugged-9de3a7e3-3152-4276-bd9e-d3ddfcac0696 for instance with vm_state active and task_state deleting.
Nov 15 06:00:13 user nova-compute[75648]: INFO nova.compute.manager [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Took 0.79 seconds to detach 1 volumes for instance.
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] [instance: fdf4097a-b7f0-4802-8abc-2583acd8ab84] Deleting volume: 1a179055-9e6f-4f14-9c27-dafa5e297715 {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.263s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:13 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Deleted allocations for instance fdf4097a-b7f0-4802-8abc-2583acd8ab84
Nov 15 06:00:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23230393533383865', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230393533383865', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-33ad51f8-fae2-4901-80f2-d298465a2ba7 tempest-TestShelveInstance-812316993 tempest-TestShelveInstance-812316993-project-member] Lock "fdf4097a-b7f0-4802-8abc-2583acd8ab84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.077s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586828384',display_name='tempest-ServerActionsTestOtherA-server-586828384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586828384',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-7g6p2edv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=23e250a1-2c65-4ba1-b8d8-09cf4334ad44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'pci_devices' on Instance uuid 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:00:13 user nova-compute[75648]:   <uuid>23e250a1-2c65-4ba1-b8d8-09cf4334ad44</uuid>
Nov 15 06:00:13 user nova-compute[75648]:   <name>instance-0000002f</name>
Nov 15 06:00:13 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:00:13 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:00:13 user nova-compute[75648]:   <metadata>
Nov 15 06:00:13 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:00:13 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:00:13 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherA-server-586828384</nova:name>
Nov 15 06:00:13 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:00:12</nova:creationTime>
Nov 15 06:00:13 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:00:13 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:00:13 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:00:13 user nova-compute[75648]:       <nova:owner>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:user uuid="5d61be40c2864afc99cd689efdb30308">tempest-ServerActionsTestOtherA-442850377-project-member</nova:user>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:project uuid="06bd3ce1caf14075b2d936ac45b143f5">tempest-ServerActionsTestOtherA-442850377</nova:project>
Nov 15 06:00:13 user nova-compute[75648]:       </nova:owner>
Nov 15 06:00:13 user nova-compute[75648]:       <nova:ports>
Nov 15 06:00:13 user nova-compute[75648]:         <nova:port uuid="0a05de2b-0610-4a54-9a2b-7b80f5c5d399">
Nov 15 06:00:13 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 06:00:13 user nova-compute[75648]:         </nova:port>
Nov 15 06:00:13 user nova-compute[75648]:       </nova:ports>
Nov 15 06:00:13 user nova-compute[75648]:     </nova:instance>
Nov 15 06:00:13 user nova-compute[75648]:   </metadata>
Nov 15 06:00:13 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:00:13 user nova-compute[75648]:     <system>
Nov 15 06:00:13 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:00:13 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:00:13 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:00:13 user nova-compute[75648]:       <entry name="serial">23e250a1-2c65-4ba1-b8d8-09cf4334ad44</entry>
Nov 15 06:00:13 user nova-compute[75648]:       <entry name="uuid">23e250a1-2c65-4ba1-b8d8-09cf4334ad44</entry>
Nov 15 06:00:13 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:00:13 user nova-compute[75648]:     </system>
Nov 15 06:00:13 user nova-compute[75648]:   </sysinfo>
Nov 15 06:00:13 user nova-compute[75648]:   <os>
Nov 15 06:00:13 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:00:13 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:00:13 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:00:13 user nova-compute[75648]:   </os>
Nov 15 06:00:13 user nova-compute[75648]:   <features>
Nov 15 06:00:13 user nova-compute[75648]:     <acpi/>
Nov 15 06:00:13 user nova-compute[75648]:     <apic/>
Nov 15 06:00:13 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:00:13 user nova-compute[75648]:   </features>
Nov 15 06:00:13 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:00:13 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:00:13 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:00:13 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:00:13 user nova-compute[75648]:   </clock>
Nov 15 06:00:13 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:00:13 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:00:13 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:00:13 user nova-compute[75648]:   </cpu>
Nov 15 06:00:13 user nova-compute[75648]:   <devices>
Nov 15 06:00:13 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 06:00:13 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:00:13 user nova-compute[75648]:       <source dev="/dev/sdb"/>
Nov 15 06:00:13 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:00:13 user nova-compute[75648]:       <serial>b99c4e57-182b-402d-8892-faf894405f79</serial>
Nov 15 06:00:13 user nova-compute[75648]:     </disk>
Nov 15 06:00:13 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:00:13 user nova-compute[75648]:       <mac address="fa:16:3e:09:73:2d"/>
Nov 15 06:00:13 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:00:13 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:00:13 user nova-compute[75648]:       <target dev="tap0a05de2b-06"/>
Nov 15 06:00:13 user nova-compute[75648]:     </interface>
Nov 15 06:00:13 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:00:13 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/23e250a1-2c65-4ba1-b8d8-09cf4334ad44/console.log" append="off"/>
Nov 15 06:00:13 user nova-compute[75648]:     </serial>
Nov 15 06:00:13 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:00:13 user nova-compute[75648]:     <video>
Nov 15 06:00:13 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:00:13 user nova-compute[75648]:     </video>
Nov 15 06:00:13 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:00:13 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:00:13 user nova-compute[75648]:     </rng>
Nov 15 06:00:13 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:00:13 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:00:13 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:00:13 user nova-compute[75648]:     </memballoon>
Nov 15 06:00:13 user nova-compute[75648]:   </devices>
Nov 15 06:00:13 user nova-compute[75648]: </domain>
Nov 15 06:00:13 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586828384',display_name='tempest-ServerActionsTestOtherA-server-586828384',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586828384',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-7g6p2edv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=23e250a1-2c65-4ba1-b8d8-09cf4334ad44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG os_vif [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc19408f-1897-5451-bee6-67adb40a099d', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a05de2b-06, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a05de2b-06, col_values=(('qos', UUID('36f7b7f1-4c7a-4837-8646-d0013389f34f')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a05de2b-06, col_values=(('external_ids', {'iface-id': '0a05de2b-0610-4a54-9a2b-7b80f5c5d399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:73:2d', 'vm-uuid': '23e250a1-2c65-4ba1-b8d8-09cf4334ad44'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:13 user nova-compute[75648]: INFO os_vif [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06')
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:00:13 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No VIF found with MAC fa:16:3e:09:73:2d, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-cf41ea62-c938-4adf-86e4-5e15a76fa0b1 req-2c2e5b92-e0ad-430d-9d2a-284a032a6f56 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cf41ea62-c938-4adf-86e4-5e15a76fa0b1 req-2c2e5b92-e0ad-430d-9d2a-284a032a6f56 service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cf41ea62-c938-4adf-86e4-5e15a76fa0b1 req-2c2e5b92-e0ad-430d-9d2a-284a032a6f56 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cf41ea62-c938-4adf-86e4-5e15a76fa0b1 req-2c2e5b92-e0ad-430d-9d2a-284a032a6f56 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG nova.compute.manager [req-cf41ea62-c938-4adf-86e4-5e15a76fa0b1 req-2c2e5b92-e0ad-430d-9d2a-284a032a6f56 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:00:15 user nova-compute[75648]: WARNING nova.compute.manager [req-cf41ea62-c938-4adf-86e4-5e15a76fa0b1 req-2c2e5b92-e0ad-430d-9d2a-284a032a6f56 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state building and task_state spawning.
Nov 15 06:00:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 06:00:17 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e is timed out.
Nov 15 06:00:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config.
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kzDwGMlC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:17 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242fb27-4a69-4413-a0f9-9b0c5db0acd2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:00:17 user nova-compute[75648]: No targets found.
Nov 15 06:00:17 user nova-compute[75648]: iSNS:
Nov 15 06:00:17 user nova-compute[75648]: No targets found.
Nov 15 06:00:17 user nova-compute[75648]: STATIC:
Nov 15 06:00:17 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:00:17 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:17 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:17 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 06:00:17 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:17 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:17 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b
Nov 15 06:00:17 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:00:17 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:00:17 user nova-compute[75648]: FIRMWARE:
Nov 15 06:00:17 user nova-compute[75648]: No targets found.
Nov 15 06:00:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:00:17 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:00:17 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef8390b-e587-4295-ba27-b6d3566a9364]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61e3130-aea5-4a4c-b1c4-15ab2356ee4a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:17 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:17 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:17 user nova-compute[75648]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b (non-flash)
Nov 15 06:00:17 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47f5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b'): ({'sde'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Removing single pathed devices sde {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[98350fc2-d58a-4877-b514-1ed363d0add8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 06:00:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance spawned successfully.
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e9987e-0b78-4a0e-96cf-ba65f020999c]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Flushing IO for device /dev/sde {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[466bfa5e-de1f-47a1-b6fa-80c05bc1b39d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf0bb05-6a5e-42b9-833b-d1126d23e52c]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] SCSI volumes sde have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e8e85e-5f75-4690-a627-d0b1af5c461a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:17 user nova-compute[75648]: INFO nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Took 5.23 seconds to spawn the instance on the hypervisor.
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-efb2a334-d7b7-45da-8d72-9590287abf11 req-01197a81-d34e-4c00-b64e-1227741554aa service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-efb2a334-d7b7-45da-8d72-9590287abf11 req-01197a81-d34e-4c00-b64e-1227741554aa service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-efb2a334-d7b7-45da-8d72-9590287abf11 req-01197a81-d34e-4c00-b64e-1227741554aa service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-efb2a334-d7b7-45da-8d72-9590287abf11 req-01197a81-d34e-4c00-b64e-1227741554aa service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.compute.manager [req-efb2a334-d7b7-45da-8d72-9590287abf11 req-01197a81-d34e-4c00-b64e-1227741554aa service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:00:17 user nova-compute[75648]: WARNING nova.compute.manager [req-efb2a334-d7b7-45da-8d72-9590287abf11 req-01197a81-d34e-4c00-b64e-1227741554aa service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state building and task_state spawning.
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[34001e32-3c1b-4df1-8ebf-d416dfa06123]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260]
Nov 15 06:00:17 user nova-compute[75648]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b, portal: 172.16.0.220,3260] successful.
Nov 15 06:00:17 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f5d9bd3-3c0c-4b0a-a17c-8f80d5ca0e4b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93481b97-b252-46d4-8ebe-682073e227ab]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== disconnect_volume: return (304ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:00:17 user nova-compute[75648]: INFO nova.compute.manager [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Took 11.56 seconds to build instance.
Nov 15 06:00:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-46431883-e4fc-40b8-8c61-5a4cc864c084 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.676s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:18 user nova-compute[75648]: DEBUG nova.objects.instance [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-affad418-eccd-4f10-b62d-472b72ecff17 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:24 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:00:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 06:00:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 06:00:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:00:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:00:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:00:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:34 user nova-compute[75648]: INFO nova.compute.manager [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Terminating instance
Nov 15 06:00:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-a8f5ba26-c7c2-4463-87d0-fd2e8366dd01 req-9d0ceef2-5af3-42f2-b626-5f74b1ffcf19 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-vif-unplugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a8f5ba26-c7c2-4463-87d0-fd2e8366dd01 req-9d0ceef2-5af3-42f2-b626-5f74b1ffcf19 service nova] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a8f5ba26-c7c2-4463-87d0-fd2e8366dd01 req-9d0ceef2-5af3-42f2-b626-5f74b1ffcf19 service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a8f5ba26-c7c2-4463-87d0-fd2e8366dd01 req-9d0ceef2-5af3-42f2-b626-5f74b1ffcf19 service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-a8f5ba26-c7c2-4463-87d0-fd2e8366dd01 req-9d0ceef2-5af3-42f2-b626-5f74b1ffcf19 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] No waiting events found dispatching network-vif-unplugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:00:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-a8f5ba26-c7c2-4463-87d0-fd2e8366dd01 req-9d0ceef2-5af3-42f2-b626-5f74b1ffcf19 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-vif-unplugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:00:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Instance destroyed successfully.
Nov 15 06:00:35 user nova-compute[75648]: DEBUG nova.objects.instance [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lazy-loading 'resources' on Instance uuid 2026767b-71cf-48f6-8f2f-7d331bad9aeb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1995337646',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1995337',id=45,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpCr89xaqZtEdDqyRa1c6egF6l9gH2P+UIAlDfPyBYRSEI2nV4lCFHYQ2i68/2iHi2i7XN7cGXOoGNpxpK+732fzEm7nCbna7kk/lL53FTdkKlMupq80gTO7fB/9Tn7Sw==',key_name='tempest-keypair-563196640',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:57:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ff44a3c0aa834bb0a91de95cf995b748',ramdisk_id='',reservation_id='r-ftuk0wsl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1965904680',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:57:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='98f7959b33774884898e9676593c3a5e',uuid=2026767b-71cf-48f6-8f2f-7d331bad9aeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Converting VIF {"id": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "address": "fa:16:3e:f6:47:06", "network": {"id": "9adb034b-de5f-4b93-9733-ffbb83053623", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1900521228-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ff44a3c0aa834bb0a91de95cf995b748", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap05d5edc1-71", "ovs_interfaceid": "05d5edc1-714b-4a82-bcdc-54fab89f7843", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG os_vif [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap05d5edc1-71, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11741f3a-0d25-40ea-a9e1-6c24f97c0651) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:00:35 user nova-compute[75648]: INFO os_vif [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:47:06,bridge_name='br-int',has_traffic_filtering=True,id=05d5edc1-714b-4a82-bcdc-54fab89f7843,network=Network(9adb034b-de5f-4b93-9733-ffbb83053623),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap05d5edc1-71')
Nov 15 06:00:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Deleting instance files /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb_del
Nov 15 06:00:35 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Deletion of /opt/stack/data/nova/instances/2026767b-71cf-48f6-8f2f-7d331bad9aeb_del complete
Nov 15 06:00:35 user nova-compute[75648]: INFO nova.compute.manager [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 06:00:35 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:00:35 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:00:36 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Took 0.61 seconds to deallocate network for instance.
Nov 15 06:00:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-6b2b0113-568b-4588-ab33-95a288766601 req-17f811bd-e6cf-4fcf-954e-b2905fe9e9d2 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-vif-deleted-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:36 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Deleted allocations for instance 2026767b-71cf-48f6-8f2f-7d331bad9aeb
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-cfd88dc0-90c0-4133-aadf-175657c0b570 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680 tempest-TestServerVolumeAttachScenarioOldVersion-1965904680-project-member] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-f01ed4c2-282a-4a52-9e8a-049fff35caf2 req-aea42d92-6798-4415-bebf-851b4ae14bf5 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received event network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f01ed4c2-282a-4a52-9e8a-049fff35caf2 req-aea42d92-6798-4415-bebf-851b4ae14bf5 service nova] Acquiring lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f01ed4c2-282a-4a52-9e8a-049fff35caf2 req-aea42d92-6798-4415-bebf-851b4ae14bf5 service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f01ed4c2-282a-4a52-9e8a-049fff35caf2 req-aea42d92-6798-4415-bebf-851b4ae14bf5 service nova] Lock "2026767b-71cf-48f6-8f2f-7d331bad9aeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-f01ed4c2-282a-4a52-9e8a-049fff35caf2 req-aea42d92-6798-4415-bebf-851b4ae14bf5 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] No waiting events found dispatching network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:00:36 user nova-compute[75648]: WARNING nova.compute.manager [req-f01ed4c2-282a-4a52-9e8a-049fff35caf2 req-aea42d92-6798-4415-bebf-851b4ae14bf5 service nova] [instance: 2026767b-71cf-48f6-8f2f-7d331bad9aeb] Received unexpected event network-vif-plugged-05d5edc1-714b-4a82-bcdc-54fab89f7843 for instance with vm_state deleted and task_state None.
Nov 15 06:00:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:49 user nova-compute[75648]: INFO nova.compute.manager [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attaching volume 51534b21-e7af-4d96-8fee-37599877616b to /dev/vdb
Nov 15 06:00:49 user nova-compute[75648]: DEBUG os_brick.utils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b08f1fd-fd52-4e65-a66f-6a6e381d3cd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bf8fcb-85ac-4d1f-ac7a-2d64eb4201ed]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc62fc16-d5ff-40c4-a340-c239cfc0d8b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[522d7320-71f7-4592-bbf1-ebfdb2236b29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:00:49 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:00:49 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b63ec83-8270-4017-a9dd-012ccb506a05]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG os_brick.utils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:49 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating existing volume attachment record: 317d0cf2-2048-4f05-80c1-5fc3b1eb4b5e {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:00:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIHueDkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:00:54 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:54 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:00:54 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba01e5fb-57d6-4162-9a7e-fb926ae7c1ca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:00:54 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bebb438-a237-4c8a-ad01-127712ed72e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b] added
Nov 15 06:00:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3415a3-232b-4b25-98ec-55bc3abbed3f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d703308-a2d0-4f4b-8206-04992dc0008e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIHueDkh {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIHueDkh" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe59417-b643-41af-9ffc-f857f58cfaf3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xIHueDkh'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[374604a9-d53c-4021-a307-1805d0dc892c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a96d9f-e9f4-4492-a4c7-cfaa1b8adefb]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fa70fc-69bb-4cec-9db0-94acda13a02e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260]
Nov 15 06:00:54 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260] successful.
Nov 15 06:00:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f866c2-d2de-4862-9485-6ca25372eb7a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[924ed177-1f68-4ba2-93d4-e4ac4c346470]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)
Nov 15 06:00:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:00:54 user nova-compute[75648]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)
Nov 15 06:00:54 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e256343-4506-47bc-a517-d937ec1199d7]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:00:54 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIHueDkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26537323461383932', 'path': '/dev/sdd'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537323461383932', 'path': '/dev/sdd'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.objects.instance [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:00:55 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:00:55 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 06:00:55 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:00:55 user nova-compute[75648]:   <serial>51534b21-e7af-4d96-8fee-37599877616b</serial>
Nov 15 06:00:55 user nova-compute[75648]: </disk>
Nov 15 06:00:55 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:55 user nova-compute[75648]: INFO nova.compute.manager [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Detaching volume 7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 06:00:55 user nova-compute[75648]: INFO nova.virt.block_device [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Attempting to driver detach volume 7e561568-26fb-4b2c-8e82-78ef935f4202 from mountpoint /dev/vdb
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Attempting to detach device vdb from instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:00:55 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:00:55 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:00:55 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:00:55 user nova-compute[75648]:   <serial>7e561568-26fb-4b2c-8e82-78ef935f4202</serial>
Nov 15 06:00:55 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 06:00:55 user nova-compute[75648]: </disk>
Nov 15 06:00:55 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:00:55 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully detached device vdb from instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b from the persistent domain config.
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:00:55 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:00:55 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:00:55 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:00:55 user nova-compute[75648]:   <serial>7e561568-26fb-4b2c-8e82-78ef935f4202</serial>
Nov 15 06:00:55 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 15 06:00:55 user nova-compute[75648]: </disk>
Nov 15 06:00:55 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] No VIF found with MAC fa:16:3e:09:c2:02, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:00:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-4faf6ebb-52a7-4590-a7b8-9854a289a13f tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.649s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:00:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:00:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:00:58 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:00:58 user nova-compute[75648]: INFO nova.compute.manager [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Detaching volume 51534b21-e7af-4d96-8fee-37599877616b
Nov 15 06:00:58 user nova-compute[75648]: INFO nova.virt.block_device [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Attempting to driver detach volume 51534b21-e7af-4d96-8fee-37599877616b from mountpoint /dev/vdb
Nov 15 06:00:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Attempting to detach device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:00:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:00:58 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:00:58 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 06:00:58 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:00:58 user nova-compute[75648]:   <serial>51534b21-e7af-4d96-8fee-37599877616b</serial>
Nov 15 06:00:58 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:00:58 user nova-compute[75648]: </disk>
Nov 15 06:00:58 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:00:58 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the persistent domain config.
Nov 15 06:00:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:00:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:00:58 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:00:58 user nova-compute[75648]:   <source dev="/dev/sdd"/>
Nov 15 06:00:58 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:00:58 user nova-compute[75648]:   <serial>51534b21-e7af-4d96-8fee-37599877616b</serial>
Nov 15 06:00:58 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:00:58 user nova-compute[75648]: </disk>
Nov 15 06:00:58 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:00:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:00:58 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:01:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "83800282-646d-4f80-b957-cbd79c2d4d05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:03 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 06:01:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:03 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:01:03 user nova-compute[75648]: INFO nova.compute.claims [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Claim successful on node user
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.369s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.network.neutron [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 06:01:04 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.policy [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e0a62de05d1849c5a3f156644a055ab8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77e850a175a24f2da81c82356262dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 06:01:04 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Creating image(s)
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "/opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "/opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "/opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:04 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk 1073741824" returned: 0 in 0.207s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.396s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.192s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG nova.network.neutron [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Successfully created port: 6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Cannot resize image /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Ensure instance console log exists: /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.network.neutron [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Successfully updated port: 6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "refresh_cache-83800282-646d-4f80-b957-cbd79c2d4d05" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquired lock "refresh_cache-83800282-646d-4f80-b957-cbd79c2d4d05" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.network.neutron [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-changed-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.manager [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Refreshing instance network info cache due to event network-changed-6e63cbcd-13a3-461b-939c-33127d04cfa9. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] Acquiring lock "refresh_cache-83800282-646d-4f80-b957-cbd79c2d4d05" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.network.neutron [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:01:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8283MB free_disk=25.168907165527344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance e21dec3d-4aa8-4066-99c8-2782c41f913e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 83800282-646d-4f80-b957-cbd79c2d4d05 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.network.neutron [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Updating instance_info_cache with network_info: [{"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Releasing lock "refresh_cache-83800282-646d-4f80-b957-cbd79c2d4d05" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Instance network_info: |[{"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] Acquired lock "refresh_cache-83800282-646d-4f80-b957-cbd79c2d4d05" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.network.neutron [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Refreshing network info cache for port 6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Start _get_guest_xml network_info=[{"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:01:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:01:06 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:01:06 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1425371564',display_name='tempest-VolumesNegativeTest-instance-1425371564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1425371564',id=48,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77e850a175a24f2da81c82356262dfe5',ramdisk_id='',reservation_id='r-0kbp3q8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1922897537',owner_user_name='tempest-VolumesNegativeTest-1922897537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:01:04Z,user_data=None,user_id='e0a62de05d1849c5a3f156644a055ab8',uuid=83800282-646d-4f80-b957-cbd79c2d4d05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Converting VIF {"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.objects.instance [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lazy-loading 'pci_devices' on Instance uuid 83800282-646d-4f80-b957-cbd79c2d4d05 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:01:07 user nova-compute[75648]:   <uuid>83800282-646d-4f80-b957-cbd79c2d4d05</uuid>
Nov 15 06:01:07 user nova-compute[75648]:   <name>instance-00000030</name>
Nov 15 06:01:07 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:01:07 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:01:07 user nova-compute[75648]:   <metadata>
Nov 15 06:01:07 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:01:07 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:01:07 user nova-compute[75648]:       <nova:name>tempest-VolumesNegativeTest-instance-1425371564</nova:name>
Nov 15 06:01:07 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:01:06</nova:creationTime>
Nov 15 06:01:07 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:01:07 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:01:07 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:01:07 user nova-compute[75648]:       <nova:owner>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:user uuid="e0a62de05d1849c5a3f156644a055ab8">tempest-VolumesNegativeTest-1922897537-project-member</nova:user>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:project uuid="77e850a175a24f2da81c82356262dfe5">tempest-VolumesNegativeTest-1922897537</nova:project>
Nov 15 06:01:07 user nova-compute[75648]:       </nova:owner>
Nov 15 06:01:07 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 06:01:07 user nova-compute[75648]:       <nova:ports>
Nov 15 06:01:07 user nova-compute[75648]:         <nova:port uuid="6e63cbcd-13a3-461b-939c-33127d04cfa9">
Nov 15 06:01:07 user nova-compute[75648]:           <nova:ip type="fixed" address="192.168.233.150" ipVersion="4"/>
Nov 15 06:01:07 user nova-compute[75648]:         </nova:port>
Nov 15 06:01:07 user nova-compute[75648]:       </nova:ports>
Nov 15 06:01:07 user nova-compute[75648]:     </nova:instance>
Nov 15 06:01:07 user nova-compute[75648]:   </metadata>
Nov 15 06:01:07 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:01:07 user nova-compute[75648]:     <system>
Nov 15 06:01:07 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:01:07 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:01:07 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:01:07 user nova-compute[75648]:       <entry name="serial">83800282-646d-4f80-b957-cbd79c2d4d05</entry>
Nov 15 06:01:07 user nova-compute[75648]:       <entry name="uuid">83800282-646d-4f80-b957-cbd79c2d4d05</entry>
Nov 15 06:01:07 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:01:07 user nova-compute[75648]:     </system>
Nov 15 06:01:07 user nova-compute[75648]:   </sysinfo>
Nov 15 06:01:07 user nova-compute[75648]:   <os>
Nov 15 06:01:07 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:01:07 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:01:07 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:01:07 user nova-compute[75648]:   </os>
Nov 15 06:01:07 user nova-compute[75648]:   <features>
Nov 15 06:01:07 user nova-compute[75648]:     <acpi/>
Nov 15 06:01:07 user nova-compute[75648]:     <apic/>
Nov 15 06:01:07 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:01:07 user nova-compute[75648]:   </features>
Nov 15 06:01:07 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:01:07 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:01:07 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:01:07 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:01:07 user nova-compute[75648]:   </clock>
Nov 15 06:01:07 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:01:07 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:01:07 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:01:07 user nova-compute[75648]:   </cpu>
Nov 15 06:01:07 user nova-compute[75648]:   <devices>
Nov 15 06:01:07 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 06:01:07 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 06:01:07 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk"/>
Nov 15 06:01:07 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:01:07 user nova-compute[75648]:     </disk>
Nov 15 06:01:07 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:01:07 user nova-compute[75648]:       <mac address="fa:16:3e:ce:bb:fd"/>
Nov 15 06:01:07 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:01:07 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:01:07 user nova-compute[75648]:       <target dev="tap6e63cbcd-13"/>
Nov 15 06:01:07 user nova-compute[75648]:     </interface>
Nov 15 06:01:07 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:01:07 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/console.log" append="off"/>
Nov 15 06:01:07 user nova-compute[75648]:     </serial>
Nov 15 06:01:07 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:01:07 user nova-compute[75648]:     <video>
Nov 15 06:01:07 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:01:07 user nova-compute[75648]:     </video>
Nov 15 06:01:07 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:01:07 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:01:07 user nova-compute[75648]:     </rng>
Nov 15 06:01:07 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:01:07 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:01:07 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:01:07 user nova-compute[75648]:     </memballoon>
Nov 15 06:01:07 user nova-compute[75648]:   </devices>
Nov 15 06:01:07 user nova-compute[75648]: </domain>
Nov 15 06:01:07 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1425371564',display_name='tempest-VolumesNegativeTest-instance-1425371564',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1425371564',id=48,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77e850a175a24f2da81c82356262dfe5',ramdisk_id='',reservation_id='r-0kbp3q8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1922897537',owner_user_name='tempest-VolumesNegativeTest-1922897537-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:01:04Z,user_data=None,user_id='e0a62de05d1849c5a3f156644a055ab8',uuid=83800282-646d-4f80-b957-cbd79c2d4d05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Converting VIF {"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG os_vif [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '520a4020-0dd0-56a5-b81b-113f7f9b8000', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e63cbcd-13, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e63cbcd-13, col_values=(('qos', UUID('09dc7089-f038-4890-8fb9-037daeda07de')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e63cbcd-13, col_values=(('external_ids', {'iface-id': '6e63cbcd-13a3-461b-939c-33127d04cfa9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:bb:fd', 'vm-uuid': '83800282-646d-4f80-b957-cbd79c2d4d05'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:07 user nova-compute[75648]: INFO os_vif [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13')
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] No VIF found with MAC fa:16:3e:ce:bb:fd, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Updated VIF entry in instance network info cache for port 6e63cbcd-13a3-461b-939c-33127d04cfa9. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Updating instance_info_cache with network_info: [{"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:01:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-16e6bb4a-5a3c-4f92-931f-139fe9e126dc req-2b4610cb-d528-44f6-88d9-d79bd2c95962 service nova] Releasing lock "refresh_cache-83800282-646d-4f80-b957-cbd79c2d4d05" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-ffbe4bba-111a-4571-87e0-27ce7d67b2c6 req-f68c311a-d38f-4c74-be9f-dbe04cd3e6fb service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ffbe4bba-111a-4571-87e0-27ce7d67b2c6 req-f68c311a-d38f-4c74-be9f-dbe04cd3e6fb service nova] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ffbe4bba-111a-4571-87e0-27ce7d67b2c6 req-f68c311a-d38f-4c74-be9f-dbe04cd3e6fb service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ffbe4bba-111a-4571-87e0-27ce7d67b2c6 req-f68c311a-d38f-4c74-be9f-dbe04cd3e6fb service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-ffbe4bba-111a-4571-87e0-27ce7d67b2c6 req-f68c311a-d38f-4c74-be9f-dbe04cd3e6fb service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] No waiting events found dispatching network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:01:08 user nova-compute[75648]: WARNING nova.compute.manager [req-ffbe4bba-111a-4571-87e0-27ce7d67b2c6 req-f68c311a-d38f-4c74-be9f-dbe04cd3e6fb service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received unexpected event network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 for instance with vm_state building and task_state spawning.
Nov 15 06:01:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating instance_info_cache with network_info: [{"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-e21dec3d-4aa8-4066-99c8-2782c41f913e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 06:01:10 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Instance spawned successfully.
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:01:10 user nova-compute[75648]: INFO nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Took 6.36 seconds to spawn the instance on the hypervisor.
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-37390e95-e12a-4351-b629-5512c68338b6 req-94f4a40b-29de-4197-84e4-45d785a0cdc0 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37390e95-e12a-4351-b629-5512c68338b6 req-94f4a40b-29de-4197-84e4-45d785a0cdc0 service nova] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37390e95-e12a-4351-b629-5512c68338b6 req-94f4a40b-29de-4197-84e4-45d785a0cdc0 service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-37390e95-e12a-4351-b629-5512c68338b6 req-94f4a40b-29de-4197-84e4-45d785a0cdc0 service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-37390e95-e12a-4351-b629-5512c68338b6 req-94f4a40b-29de-4197-84e4-45d785a0cdc0 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] No waiting events found dispatching network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:01:10 user nova-compute[75648]: WARNING nova.compute.manager [req-37390e95-e12a-4351-b629-5512c68338b6 req-94f4a40b-29de-4197-84e4-45d785a0cdc0 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received unexpected event network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 for instance with vm_state building and task_state spawning.
Nov 15 06:01:10 user nova-compute[75648]: INFO nova.compute.manager [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Took 7.05 seconds to build instance.
Nov 15 06:01:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-61ad0bf5-f03a-4581-8750-ab7abbdb5710 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "83800282-646d-4f80-b957-cbd79c2d4d05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.141s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:16 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b is timed out.
Nov 15 06:01:16 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully detached device vdb from instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b from the live domain config.
Nov 15 06:01:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GWKuoMbT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:01:16 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf5a53b-6191-4b5f-befb-04cd8de05604]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:01:16 user nova-compute[75648]: No targets found.
Nov 15 06:01:16 user nova-compute[75648]: iSNS:
Nov 15 06:01:16 user nova-compute[75648]: No targets found.
Nov 15 06:01:16 user nova-compute[75648]: STATIC:
Nov 15 06:01:16 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:01:16 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:16 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:16 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202
Nov 15 06:01:16 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:16 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:16 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b
Nov 15 06:01:16 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:16 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:16 user nova-compute[75648]: FIRMWARE:
Nov 15 06:01:16 user nova-compute[75648]: No targets found.
Nov 15 06:01:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:01:16 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:01:16 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf83161-b02d-4177-ab77-87d0a6268084]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6737093-2210-4cce-9a72-99e5a8d6b293]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:01:16 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:16 user nova-compute[75648]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)
Nov 15 06:01:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 (non-flash)
Nov 15 06:01:16 user nova-compute[75648]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:16 user nova-compute[75648]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)
Nov 15 06:01:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e841d3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[8297110f-644e-4474-bfd1-aadec67cc230]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d22d373-0d5d-4e4a-8ddd-e25a806d9d49]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3362a2-5922-40a5-9c00-0dfe6678d44b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b61a584-c40a-4170-a6ba-ff6ee137fa80]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9f098e-b148-41c2-a909-f1b54b2dc0e6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a397f4-1167-408d-b0a3-3cf2248ba444]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260]
Nov 15 06:01:16 user nova-compute[75648]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202, portal: 172.16.0.220,3260] successful.
Nov 15 06:01:16 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e561568-26fb-4b2c-8e82-78ef935f4202 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[06efb33e-2f47-4a1c-ae08-70c305ab5533]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== disconnect_volume: return (303ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:01:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:01:17 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:17 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1104e1fa-7900-4196-a7af-11dd7b107fea tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.691s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75648) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-5ce5f49a-1de0-483b-be72-8875554cf6c9 req-b6403616-69c6-44d9-8bab-43b71b92266f service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5ce5f49a-1de0-483b-be72-8875554cf6c9 req-b6403616-69c6-44d9-8bab-43b71b92266f service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5ce5f49a-1de0-483b-be72-8875554cf6c9 req-b6403616-69c6-44d9-8bab-43b71b92266f service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5ce5f49a-1de0-483b-be72-8875554cf6c9 req-b6403616-69c6-44d9-8bab-43b71b92266f service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-5ce5f49a-1de0-483b-be72-8875554cf6c9 req-b6403616-69c6-44d9-8bab-43b71b92266f service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:01:18 user nova-compute[75648]: WARNING nova.compute.manager [req-5ce5f49a-1de0-483b-be72-8875554cf6c9 req-b6403616-69c6-44d9-8bab-43b71b92266f service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state active and task_state powering-off.
Nov 15 06:01:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance destroyed successfully.
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b0813c96-59a9-4b7a-ac73-c21a4a424f13 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.837s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e21dec3d-4aa8-4066-99c8-2782c41f913e is timed out.
Nov 15 06:01:18 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully detached device vdb from instance e21dec3d-4aa8-4066-99c8-2782c41f913e from the live domain config.
Nov 15 06:01:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIHueDkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:01:18 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:01:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:01:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb47b60-de1f-4432-b38b-8bd4344f90e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:01:19 user nova-compute[75648]: No targets found.
Nov 15 06:01:19 user nova-compute[75648]: iSNS:
Nov 15 06:01:19 user nova-compute[75648]: No targets found.
Nov 15 06:01:19 user nova-compute[75648]: STATIC:
Nov 15 06:01:19 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:01:19 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:19 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:19 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b
Nov 15 06:01:19 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:19 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:19 user nova-compute[75648]: FIRMWARE:
Nov 15 06:01:19 user nova-compute[75648]: No targets found.
Nov 15 06:01:19 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:01:19 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:01:19 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[110babcc-7a8b-475a-9bcb-6ca0ee956a4f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27f74e7-4693-4692-b2ba-31d33dfb004d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:19 user nova-compute[75648]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)
Nov 15 06:01:19 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:19 user nova-compute[75648]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b (non-flash)
Nov 15 06:01:19 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47dc280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b'): ({'sdd'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Removing single pathed devices sdd {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[21343795-2278-4568-b027-c955092f516f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[846ad5d3-2de2-400c-8ae5-857db3246d7b]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Flushing IO for device /dev/sdd {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[052bacbb-562e-4073-9ea8-75b751e7ebe8]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.030s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7986889-8719-4ea0-b0d9-a4df8987fb22]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] SCSI volumes sdd have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fc88c4-9f71-4e17-a33a-8e15a0bb1472]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5037e51f-5ee0-4697-9f3b-8055bf2b368a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260]
Nov 15 06:01:19 user nova-compute[75648]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b, portal: 172.16.0.220,3260] successful.
Nov 15 06:01:19 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:51534b21-e7af-4d96-8fee-37599877616b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27c5ca3-e87a-40e3-8e68-26e01d3fa47d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.264s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] <== disconnect_volume: return (265ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:01:19 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'flavor' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1f96ab3d-1e20-4609-b3bd-2fb75924a90c tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.616s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae318ca5-2ae3-42ea-9b61-27ac2149792f req-6c2fc043-90a6-4027-8ed9-94e3601d65a0 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae318ca5-2ae3-42ea-9b61-27ac2149792f req-6c2fc043-90a6-4027-8ed9-94e3601d65a0 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae318ca5-2ae3-42ea-9b61-27ac2149792f req-6c2fc043-90a6-4027-8ed9-94e3601d65a0 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ae318ca5-2ae3-42ea-9b61-27ac2149792f req-6c2fc043-90a6-4027-8ed9-94e3601d65a0 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-ae318ca5-2ae3-42ea-9b61-27ac2149792f req-6c2fc043-90a6-4027-8ed9-94e3601d65a0 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:01:20 user nova-compute[75648]: WARNING nova.compute.manager [req-ae318ca5-2ae3-42ea-9b61-27ac2149792f req-6c2fc043-90a6-4027-8ed9-94e3601d65a0 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state stopped and task_state None.
Nov 15 06:01:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:22 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:01:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-changed-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Refreshing instance network info cache due to event network-changed-91befc9d-8f30-4e55-a8d1-133756c3a773. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:01:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] Acquiring lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] Acquired lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:22 user nova-compute[75648]: DEBUG nova.network.neutron [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Refreshing network info cache for port 91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:01:23 user nova-compute[75648]: DEBUG nova.network.neutron [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updated VIF entry in instance network info cache for port 91befc9d-8f30-4e55-a8d1-133756c3a773. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:01:23 user nova-compute[75648]: DEBUG nova.network.neutron [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updating instance_info_cache with network_info: [{"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:01:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d7d2ad02-e6e9-4036-88ec-1e374cb485d3 req-c66aa243-1109-4880-91c0-03f429bd48e0 service nova] Releasing lock "refresh_cache-6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:01:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:24 user nova-compute[75648]: INFO nova.compute.manager [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Attaching volume 008b8602-d690-4916-a8f1-3ea289729deb to /dev/vdb
Nov 15 06:01:24 user nova-compute[75648]: DEBUG os_brick.utils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9261f837-9917-4ee9-bc47-d11f96a9a64d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[68be4451-ddc0-45ef-83bd-f3a78eebdab6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec47d2f-cf56-48bf-aa72-707a5485eb6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ddb5f-2a83-420a-88f7-ecdd590a506d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:01:24 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:01:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfc1f8c-67fb-420f-ac36-b77801556a1a]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG os_brick.utils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:01:24 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updating existing volume attachment record: eda2b00f-20e2-415e-8931-b40fea26e6ea {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:01:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNaKuSPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:01:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:01:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:01:29 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9617e0b4-446b-449f-b63b-a2449bbacc89]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:01:29 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5cc04d-bd66-4e7c-86d2-33cb58c1a765]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb] added
Nov 15 06:01:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb814831-5a76-4dd8-95cf-bef8c42ca351]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a878dd-6027-4bfc-999b-a83099052e3b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNaKuSPT {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dNaKuSPT" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3be5cf-9429-4b8c-8ae2-37f7811d02eb]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dNaKuSPT'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3204dd6a-f78b-41c8-8861-fe9680937672]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3083180-0a12-4898-bab7-d75097c07a87]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48f0b57-02d9-49a8-b98a-c33f9231b9c6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260]
Nov 15 06:01:29 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260] successful.
Nov 15 06:01:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cae137-0745-4159-b17a-47c22d55ab6e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50c6535-4642-4356-a7aa-1cc3094ad37e]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:29 user nova-compute[75648]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb (non-flash)
Nov 15 06:01:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:29 user nova-compute[75648]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb (non-flash)
Nov 15 06:01:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fa1a8a-ab48-4999-8dda-31b7b80edfb2]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:01:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNaKuSPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:01:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:01:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23165653435353362', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:01:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165653435353362', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:01:30 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:01:31 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:01:31 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:01:31 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:01:31 user nova-compute[75648]:   <serial>008b8602-d690-4916-a8f1-3ea289729deb</serial>
Nov 15 06:01:31 user nova-compute[75648]: </disk>
Nov 15 06:01:31 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:01:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:01:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:01:31 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:26:79:4b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:01:31 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2161b897-4fd2-41db-a36e-769c1fce887a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.833s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:32 user nova-compute[75648]: INFO nova.compute.manager [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Detaching volume 008b8602-d690-4916-a8f1-3ea289729deb
Nov 15 06:01:32 user nova-compute[75648]: INFO nova.virt.block_device [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Attempting to driver detach volume 008b8602-d690-4916-a8f1-3ea289729deb from mountpoint /dev/vdb
Nov 15 06:01:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Attempting to detach device vdb from instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:01:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:01:32 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:01:32 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:01:32 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:01:32 user nova-compute[75648]:   <serial>008b8602-d690-4916-a8f1-3ea289729deb</serial>
Nov 15 06:01:32 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:01:32 user nova-compute[75648]: </disk>
Nov 15 06:01:32 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:01:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully detached device vdb from instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb from the persistent domain config.
Nov 15 06:01:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:01:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:01:32 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:01:32 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:01:32 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:01:32 user nova-compute[75648]:   <serial>008b8602-d690-4916-a8f1-3ea289729deb</serial>
Nov 15 06:01:32 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:01:32 user nova-compute[75648]: </disk>
Nov 15 06:01:32 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:01:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:01:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:47 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:53 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb is timed out.
Nov 15 06:01:53 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully detached device vdb from instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb from the live domain config.
Nov 15 06:01:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dNaKuSPT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:01:53 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b57fb4-cf30-4ec5-bb72-ea4ba792f76a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:01:53 user nova-compute[75648]: No targets found.
Nov 15 06:01:53 user nova-compute[75648]: iSNS:
Nov 15 06:01:53 user nova-compute[75648]: No targets found.
Nov 15 06:01:53 user nova-compute[75648]: STATIC:
Nov 15 06:01:53 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:01:53 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:53 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:53 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb
Nov 15 06:01:53 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:01:53 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:01:53 user nova-compute[75648]: FIRMWARE:
Nov 15 06:01:53 user nova-compute[75648]: No targets found.
Nov 15 06:01:53 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:01:53 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:01:53 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce00dc7-83d1-44f4-a0c1-e33a6b0518f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5116958-a51c-4dd8-bf1e-df3b0ac632cb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:53 user nova-compute[75648]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb (non-flash)
Nov 15 06:01:53 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:01:53 user nova-compute[75648]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb (non-flash)
Nov 15 06:01:53 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47f4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd9ef89-e88c-4470-9e2e-dfad6360d054]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7365d914-f42f-4f6c-b8ed-6362163e4462]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef44104-d7a7-4807-9f8c-b67d7f2dbbb5]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aea42b9-e15f-4a0a-9364-f1b1cb0ea044]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e28638-a8bd-40e4-990c-566f0e9509f6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6becef-89ed-4589-a5c6-69dd8843e8e3]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260]
Nov 15 06:01:53 user nova-compute[75648]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb, portal: 172.16.0.220,3260] successful.
Nov 15 06:01:53 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:008b8602-d690-4916-a8f1-3ea289729deb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[125cc1ac-1ca5-4f68-9f08-a1812f8e685e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== disconnect_volume: return (284ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:01:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:01:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e08effd9-a641-48cd-a358-842bc49c55af tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.602s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-changed-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Refreshing instance network info cache due to event network-changed-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG nova.network.neutron [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Refreshing network info cache for port 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG nova.network.neutron [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated VIF entry in instance network info cache for port 7f136ac9-7a79-436e-a0a9-9bee09fcf9b1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG nova.network.neutron [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:01:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d5804903-2388-443b-8915-e60ae580ac6b req-9a6c0493-4529-45bd-942f-230e42716c0f service nova] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Stashing vm_state: active {{(pid=75648) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:01:59 user nova-compute[75648]: INFO nova.compute.claims [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Claim successful on node user
Nov 15 06:01:59 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating resource usage from migration 16496fce-e1f9-4226-9bec-bff641cd6222
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-changed-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Refreshing instance network info cache due to event network-changed-0a05de2b-0610-4a54-9a2b-7b80f5c5d399. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Refreshing network info cache for port 0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.410s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:01:59 user nova-compute[75648]: INFO nova.compute.manager [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Migrating
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updated VIF entry in instance network info cache for port 0a05de2b-0610-4a54-9a2b-7b80f5c5d399. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.network.neutron [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4b1f119c-3faf-4ef3-9560-06a311b44f79 req-dc88411a-d07b-453c-9560-3165610607b0 service nova] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:01:59 user nova-compute[75648]: DEBUG nova.network.neutron [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.network.neutron [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Starting migrate_disk_and_power_off {{(pid=75648) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-aa63cc80-cf79-4895-9c40-c527cd436e8a req-233f4eda-c57d-4796-aad0-6e0372018ac6 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-unplugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aa63cc80-cf79-4895-9c40-c527cd436e8a req-233f4eda-c57d-4796-aad0-6e0372018ac6 service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aa63cc80-cf79-4895-9c40-c527cd436e8a req-233f4eda-c57d-4796-aad0-6e0372018ac6 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aa63cc80-cf79-4895-9c40-c527cd436e8a req-233f4eda-c57d-4796-aad0-6e0372018ac6 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-aa63cc80-cf79-4895-9c40-c527cd436e8a req-233f4eda-c57d-4796-aad0-6e0372018ac6 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-unplugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:00 user nova-compute[75648]: WARNING nova.compute.manager [req-aa63cc80-cf79-4895-9c40-c527cd436e8a req-233f4eda-c57d-4796-aad0-6e0372018ac6 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-unplugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state active and task_state resize_migrating.
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance destroyed successfully.
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586828384',display_name='tempest-ServerActionsTestOtherA-server-586828384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586828384',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-7g6p2edv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:01:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=23e250a1-2c65-4ba1-b8d8-09cf4334ad44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG os_vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a05de2b-06, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=36f7b7f1-4c7a-4837-8646-d0013389f34f) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:00 user nova-compute[75648]: INFO os_vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06')
Nov 15 06:02:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:02:00 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:02:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[223a9a92-c60d-4324-a76d-32477fbd8ef2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:02:00 user nova-compute[75648]: No targets found.
Nov 15 06:02:00 user nova-compute[75648]: iSNS:
Nov 15 06:02:00 user nova-compute[75648]: No targets found.
Nov 15 06:02:00 user nova-compute[75648]: STATIC:
Nov 15 06:02:00 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:02:00 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:02:00 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:02:00 user nova-compute[75648]: FIRMWARE:
Nov 15 06:02:00 user nova-compute[75648]: No targets found.
Nov 15 06:02:00 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:02:01 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:02:01 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93921d88-f544-4999-9fc1-d5b8100ae179]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92d735a-bf56-4fc7-9590-7d444e044747]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:02:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:02:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9f9fe4af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b93650-c2dc-44b0-bab3-2e3ab8ff4163]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0513a6-68ed-4c0f-adea-bebcfebf939b]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bc3ecd-e178-405e-95f3-c068e04bdce4]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aa6109-d04a-483b-9e95-021700b21957]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO50b2c0ea-2095388e60fdeb72', '/dev/disk/by-id/scsi-23230393533383865', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_50b2c0ea') {{(pid=87015) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c002785-01ed-4c32-aedf-387dcb9fcc61]: (4, None) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1257b11-e4b9-4424-b51f-8b8718bbc3e6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a2915-0659-4840-93cf-335b44a9b3ba]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]
Nov 15 06:02:01 user nova-compute[75648]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.
Nov 15 06:02:01 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa3ae25-3393-4c5a-9563-1cfd593aff42]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== disconnect_volume: return (312ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:02:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Port 0a05de2b-0610-4a54-9a2b-7b80f5c5d399 binding to destination host user is already ACTIVE {{(pid=75648) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:02 user nova-compute[75648]: INFO nova.compute.manager [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Terminating instance
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.compute.manager [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.network.neutron [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-a95a8316-483b-4f70-a962-5057e4e0968a req-5eae78f7-9549-4288-804c-d8d6c5e06861 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a95a8316-483b-4f70-a962-5057e4e0968a req-5eae78f7-9549-4288-804c-d8d6c5e06861 service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a95a8316-483b-4f70-a962-5057e4e0968a req-5eae78f7-9549-4288-804c-d8d6c5e06861 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-a95a8316-483b-4f70-a962-5057e4e0968a req-5eae78f7-9549-4288-804c-d8d6c5e06861 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-a95a8316-483b-4f70-a962-5057e4e0968a req-5eae78f7-9549-4288-804c-d8d6c5e06861 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:02 user nova-compute[75648]: WARNING nova.compute.manager [req-a95a8316-483b-4f70-a962-5057e4e0968a req-5eae78f7-9549-4288-804c-d8d6c5e06861 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state active and task_state resize_migrated.
Nov 15 06:02:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b3ac4a1-b7d7-4020-bef3-6b94eed7a5da req-fe05e6fd-cd1a-436d-8a53-3823767694d9 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-vif-unplugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b3ac4a1-b7d7-4020-bef3-6b94eed7a5da req-fe05e6fd-cd1a-436d-8a53-3823767694d9 service nova] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b3ac4a1-b7d7-4020-bef3-6b94eed7a5da req-fe05e6fd-cd1a-436d-8a53-3823767694d9 service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-8b3ac4a1-b7d7-4020-bef3-6b94eed7a5da req-fe05e6fd-cd1a-436d-8a53-3823767694d9 service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b3ac4a1-b7d7-4020-bef3-6b94eed7a5da req-fe05e6fd-cd1a-436d-8a53-3823767694d9 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] No waiting events found dispatching network-vif-unplugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-8b3ac4a1-b7d7-4020-bef3-6b94eed7a5da req-fe05e6fd-cd1a-436d-8a53-3823767694d9 service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-vif-unplugged-4b5abff5-290e-466d-8fb6-a7fe513056cd for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:02:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Instance destroyed successfully.
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lazy-loading 'resources' on Instance uuid e21dec3d-4aa8-4066-99c8-2782c41f913e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1812702776',display_name='tempest-SnapshotDataIntegrityTests-server-1812702776',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1812702776',id=44,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsYf5j0XOt1m0HaO+58/YL85UALjSjTVu947ridnaizjlccoHwgJGpt+gCdEKdsFG57ezeKdybOz2uQLB753JuNI+ReX9XPvy2OwcTKILTvfrPioSwTUqdEtrojYo4t5g==',key_name='tempest-keypair-1421163534',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd36638b70b3408e89a1f04557ff9324',ramdisk_id='',reservation_id='r-hpze54vb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-855355549',owner_user_name='tempest-SnapshotDataIntegrityTests-855355549-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:55:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ae6fbc67c6147f6bb3dcf77e5426374',uuid=e21dec3d-4aa8-4066-99c8-2782c41f913e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Converting VIF {"id": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "address": "fa:16:3e:09:c2:02", "network": {"id": "6ab33f54-c0cf-4681-b968-8e20b474b7e7", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-213864497-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd36638b70b3408e89a1f04557ff9324", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4b5abff5-29", "ovs_interfaceid": "4b5abff5-290e-466d-8fb6-a7fe513056cd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_vif [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4b5abff5-29, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5a3d9d36-8d1e-4f97-825b-f5ff715f741a) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: INFO os_vif [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:c2:02,bridge_name='br-int',has_traffic_filtering=True,id=4b5abff5-290e-466d-8fb6-a7fe513056cd,network=Network(6ab33f54-c0cf-4681-b968-8e20b474b7e7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4b5abff5-29')
Nov 15 06:02:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Deleting instance files /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e_del
Nov 15 06:02:03 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Deletion of /opt/stack/data/nova/instances/e21dec3d-4aa8-4066-99c8-2782c41f913e_del complete
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.network.neutron [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:02:03 user nova-compute[75648]: INFO nova.compute.manager [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_brick.utils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac09409-d4b5-4fe8-886a-499488b12b6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74dc5d4-9180-4bc8-a4d4-5a632d595c45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b468121-d43e-4cb1-8a70-c188b081824e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[66137d39-211b-47b1-8358-5a09cef72723]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:02:03 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:02:03 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e91324da-a34e-4eac-ab8c-1e45c810680e]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:02:03 user nova-compute[75648]: DEBUG os_brick.utils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:04 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Took 0.74 seconds to deallocate network for instance.
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:04 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Deleted allocations for instance e21dec3d-4aa8-4066-99c8-2782c41f913e
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1e3344d0-987d-43c7-8342-947d856a0ee4 tempest-SnapshotDataIntegrityTests-855355549 tempest-SnapshotDataIntegrityTests-855355549-project-member] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.048s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] Acquiring lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] Lock "e21dec3d-4aa8-4066-99c8-2782c41f913e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] No waiting events found dispatching network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:04 user nova-compute[75648]: WARNING nova.compute.manager [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received unexpected event network-vif-plugged-4b5abff5-290e-466d-8fb6-a7fe513056cd for instance with vm_state deleted and task_state None.
Nov 15 06:02:04 user nova-compute[75648]: DEBUG nova.compute.manager [req-f45cd644-050f-46d6-b865-644261a6be33 req-58559533-21cb-4a59-915e-a141eb981bed service nova] [instance: e21dec3d-4aa8-4066-99c8-2782c41f913e] Received event network-vif-deleted-4b5abff5-290e-466d-8fb6-a7fe513056cd {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:05 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:06 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:02:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8650MB free_disk=25.165359497070312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Applying migration context for instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 as it has an incoming, in-progress migration 16496fce-e1f9-4226-9bec-bff641cd6222. Migration status is post-migrating {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 06:02:07 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating resource usage from migration 16496fce-e1f9-4226-9bec-bff641cd6222
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 83800282-646d-4f80-b957-cbd79c2d4d05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Migration 16496fce-e1f9-4226-9bec-bff641cd6222 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.376s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Starting finish_migration {{(pid=75648) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance directory exists: not creating {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 15 06:02:07 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Creating image(s)
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Did not create local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Ensure instance console log exists: /opt/stack/data/nova/instances/23e250a1-2c65-4ba1-b8d8-09cf4334ad44/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Start _get_guest_xml network_info=[{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'attachment_id': '86d201a0-9fdd-4b09-8818-30da210502a6', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '23e250a1-2c65-4ba1-b8d8-09cf4334ad44', 'attached_at': '2023-11-15T06:02:08.000000', 'detached_at': '', 'volume_id': 'b99c4e57-182b-402d-8892-faf894405f79', 'serial': 'b99c4e57-182b-402d-8892-faf894405f79'}, 'delete_on_termination': True, 'volume_type': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:02:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:02:07 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:35:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:02:07 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:02:07 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:02:07 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b22efa7-cc6a-42b7-9c9e-460b13687a1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:02:07 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b4b30f-c3c2-48bc-9dfe-538ce1d73c21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79] added
Nov 15 06:02:07 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.062s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b235c70d-9ff4-4411-ad36-0478da325823]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[056e1a42-8b0b-4a4f-94ec-6f43a86eeac6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHMyPpVI {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JHMyPpVI" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9c5d60-41e7-4222-a061-658b18863ecc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JHMyPpVI'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a097fbea-4512-47e4-8d0f-6c76cba61d75]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b1d146-e3eb-49c9-8145-64251411da12]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 06:02:08 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 06:02:08 user nova-compute[75648]:  {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:02:08 user nova-compute[75648]: WARNING os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 06:02:08 user nova-compute[75648]: 
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[45692e68-c7e0-4c1b-a468-f19217cc0f9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]
Nov 15 06:02:08 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.
Nov 15 06:02:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[030e75b8-024c-4705-84cf-2293184fe10f]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a85ac6-7532-4d1c-a373-89593f662cb0]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:02:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:02:08 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.507s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eba5f2-8059-4218-b736-cd056744f532]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '23230393533383865', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230393533383865', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586828384',display_name='tempest-ServerActionsTestOtherA-server-586828384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586828384',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-7g6p2edv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=23e250a1-2c65-4ba1-b8d8-09cf4334ad44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:02:09 user nova-compute[75648]:   <uuid>23e250a1-2c65-4ba1-b8d8-09cf4334ad44</uuid>
Nov 15 06:02:09 user nova-compute[75648]:   <name>instance-0000002f</name>
Nov 15 06:02:09 user nova-compute[75648]:   <memory>2097152</memory>
Nov 15 06:02:09 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:02:09 user nova-compute[75648]:   <metadata>
Nov 15 06:02:09 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:02:09 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:02:09 user nova-compute[75648]:       <nova:name>tempest-ServerActionsTestOtherA-server-586828384</nova:name>
Nov 15 06:02:09 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:02:07</nova:creationTime>
Nov 15 06:02:09 user nova-compute[75648]:       <nova:flavor name="m1.small">
Nov 15 06:02:09 user nova-compute[75648]:         <nova:memory>2048</nova:memory>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:disk>20</nova:disk>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:02:09 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:02:09 user nova-compute[75648]:       <nova:owner>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:user uuid="5d61be40c2864afc99cd689efdb30308">tempest-ServerActionsTestOtherA-442850377-project-member</nova:user>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:project uuid="06bd3ce1caf14075b2d936ac45b143f5">tempest-ServerActionsTestOtherA-442850377</nova:project>
Nov 15 06:02:09 user nova-compute[75648]:       </nova:owner>
Nov 15 06:02:09 user nova-compute[75648]:       <nova:ports>
Nov 15 06:02:09 user nova-compute[75648]:         <nova:port uuid="0a05de2b-0610-4a54-9a2b-7b80f5c5d399">
Nov 15 06:02:09 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 15 06:02:09 user nova-compute[75648]:         </nova:port>
Nov 15 06:02:09 user nova-compute[75648]:       </nova:ports>
Nov 15 06:02:09 user nova-compute[75648]:     </nova:instance>
Nov 15 06:02:09 user nova-compute[75648]:   </metadata>
Nov 15 06:02:09 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:02:09 user nova-compute[75648]:     <system>
Nov 15 06:02:09 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:02:09 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:02:09 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:02:09 user nova-compute[75648]:       <entry name="serial">23e250a1-2c65-4ba1-b8d8-09cf4334ad44</entry>
Nov 15 06:02:09 user nova-compute[75648]:       <entry name="uuid">23e250a1-2c65-4ba1-b8d8-09cf4334ad44</entry>
Nov 15 06:02:09 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:02:09 user nova-compute[75648]:     </system>
Nov 15 06:02:09 user nova-compute[75648]:   </sysinfo>
Nov 15 06:02:09 user nova-compute[75648]:   <os>
Nov 15 06:02:09 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:02:09 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:02:09 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:02:09 user nova-compute[75648]:   </os>
Nov 15 06:02:09 user nova-compute[75648]:   <features>
Nov 15 06:02:09 user nova-compute[75648]:     <acpi/>
Nov 15 06:02:09 user nova-compute[75648]:     <apic/>
Nov 15 06:02:09 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:02:09 user nova-compute[75648]:   </features>
Nov 15 06:02:09 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:02:09 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:02:09 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:02:09 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:02:09 user nova-compute[75648]:   </clock>
Nov 15 06:02:09 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:02:09 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:02:09 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:02:09 user nova-compute[75648]:   </cpu>
Nov 15 06:02:09 user nova-compute[75648]:   <devices>
Nov 15 06:02:09 user nova-compute[75648]:     <disk type="block" device="disk">
Nov 15 06:02:09 user nova-compute[75648]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:02:09 user nova-compute[75648]:       <source dev="/dev/sdb"/>
Nov 15 06:02:09 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:02:09 user nova-compute[75648]:       <serial>b99c4e57-182b-402d-8892-faf894405f79</serial>
Nov 15 06:02:09 user nova-compute[75648]:     </disk>
Nov 15 06:02:09 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:02:09 user nova-compute[75648]:       <mac address="fa:16:3e:09:73:2d"/>
Nov 15 06:02:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:02:09 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:02:09 user nova-compute[75648]:       <target dev="tap0a05de2b-06"/>
Nov 15 06:02:09 user nova-compute[75648]:     </interface>
Nov 15 06:02:09 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:02:09 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/23e250a1-2c65-4ba1-b8d8-09cf4334ad44/console.log" append="off"/>
Nov 15 06:02:09 user nova-compute[75648]:     </serial>
Nov 15 06:02:09 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:02:09 user nova-compute[75648]:     <video>
Nov 15 06:02:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:02:09 user nova-compute[75648]:     </video>
Nov 15 06:02:09 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:02:09 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:02:09 user nova-compute[75648]:     </rng>
Nov 15 06:02:09 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:02:09 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:02:09 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:02:09 user nova-compute[75648]:     </memballoon>
Nov 15 06:02:09 user nova-compute[75648]:   </devices>
Nov 15 06:02:09 user nova-compute[75648]: </domain>
Nov 15 06:02:09 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586828384',display_name='tempest-ServerActionsTestOtherA-server-586828384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586828384',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:00:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-7g6p2edv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:02:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=23e250a1-2c65-4ba1-b8d8-09cf4334ad44,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-513549052-network", "vif_mac": "fa:16:3e:09:73:2d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG os_vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bc19408f-1897-5451-bee6-67adb40a099d', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a05de2b-06, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a05de2b-06, col_values=(('qos', UUID('e5080927-10f0-4f05-8419-b1be1d70caed')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a05de2b-06, col_values=(('external_ids', {'iface-id': '0a05de2b-0610-4a54-9a2b-7b80f5c5d399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:73:2d', 'vm-uuid': '23e250a1-2c65-4ba1-b8d8-09cf4334ad44'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:09 user nova-compute[75648]: INFO os_vif [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06')
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:02:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] No VIF found with MAC fa:16:3e:09:73:2d, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:02:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-2a9da05a-61a3-45a3-a404-35880af34004 req-3790f346-1ef7-49ae-a961-ab74b9f766b6 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2a9da05a-61a3-45a3-a404-35880af34004 req-3790f346-1ef7-49ae-a961-ab74b9f766b6 service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2a9da05a-61a3-45a3-a404-35880af34004 req-3790f346-1ef7-49ae-a961-ab74b9f766b6 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-2a9da05a-61a3-45a3-a404-35880af34004 req-3790f346-1ef7-49ae-a961-ab74b9f766b6 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG nova.compute.manager [req-2a9da05a-61a3-45a3-a404-35880af34004 req-3790f346-1ef7-49ae-a961-ab74b9f766b6 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:11 user nova-compute[75648]: WARNING nova.compute.manager [req-2a9da05a-61a3-45a3-a404-35880af34004 req-3790f346-1ef7-49ae-a961-ab74b9f766b6 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state active and task_state resize_finish.
Nov 15 06:02:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:11 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:02:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:02:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:02:12 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance running successfully.
Nov 15 06:02:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Failed to set time: agent not configured {{(pid=75648) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 15 06:02:12 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-15640b0e-c7a5-4684-b70c-34a4e08de171 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] finish_migration finished successfully. {{(pid=75648) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 15 06:02:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-5e3897c2-8975-404c-810a-0384e1eba59f req-665d8b8d-79b3-4094-b256-eae76fbdd0f3 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5e3897c2-8975-404c-810a-0384e1eba59f req-665d8b8d-79b3-4094-b256-eae76fbdd0f3 service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5e3897c2-8975-404c-810a-0384e1eba59f req-665d8b8d-79b3-4094-b256-eae76fbdd0f3 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5e3897c2-8975-404c-810a-0384e1eba59f req-665d8b8d-79b3-4094-b256-eae76fbdd0f3 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:13 user nova-compute[75648]: DEBUG nova.compute.manager [req-5e3897c2-8975-404c-810a-0384e1eba59f req-665d8b8d-79b3-4094-b256-eae76fbdd0f3 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:13 user nova-compute[75648]: WARNING nova.compute.manager [req-5e3897c2-8975-404c-810a-0384e1eba59f req-665d8b8d-79b3-4094-b256-eae76fbdd0f3 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state resized and task_state None.
Nov 15 06:02:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:23 user nova-compute[75648]: INFO nova.compute.manager [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Terminating instance
Nov 15 06:02:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-aafabb27-55d1-46ed-a776-5ee3c3eef843 req-30ef6f60-63ad-4140-905f-eab03431ffb7 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-vif-unplugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aafabb27-55d1-46ed-a776-5ee3c3eef843 req-30ef6f60-63ad-4140-905f-eab03431ffb7 service nova] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aafabb27-55d1-46ed-a776-5ee3c3eef843 req-30ef6f60-63ad-4140-905f-eab03431ffb7 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aafabb27-55d1-46ed-a776-5ee3c3eef843 req-30ef6f60-63ad-4140-905f-eab03431ffb7 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-aafabb27-55d1-46ed-a776-5ee3c3eef843 req-30ef6f60-63ad-4140-905f-eab03431ffb7 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] No waiting events found dispatching network-vif-unplugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-aafabb27-55d1-46ed-a776-5ee3c3eef843 req-30ef6f60-63ad-4140-905f-eab03431ffb7 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-vif-unplugged-91befc9d-8f30-4e55-a8d1-133756c3a773 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:02:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Instance destroyed successfully.
Nov 15 06:02:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'resources' on Instance uuid 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:59:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1548025858',display_name='tempest-AttachVolumeNegativeTest-server-1548025858',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1548025858',id=46,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlqy9plOS6Q5M9dY6TF5tBpO2unzedVdsFz045vtODgaI1TMIvgNnEAukA6VBxB8P9C/ZSFvn786Rl0ocrZpk9X73B2+Z+iXN6tLpnh2vxhamXcj7GSGUSuP8oyLhriJA==',key_name='tempest-keypair-772132',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:59:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-63dy7hrg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:59:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "91befc9d-8f30-4e55-a8d1-133756c3a773", "address": "fa:16:3e:26:79:4b", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91befc9d-8f", "ovs_interfaceid": "91befc9d-8f30-4e55-a8d1-133756c3a773", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG os_vif [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91befc9d-8f, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02e9cc6e-4a32-4f5f-9e7f-8ee243a0e16d) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:24 user nova-compute[75648]: INFO os_vif [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:26:79:4b,bridge_name='br-int',has_traffic_filtering=True,id=91befc9d-8f30-4e55-a8d1-133756c3a773,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91befc9d-8f')
Nov 15 06:02:24 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Deleting instance files /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb_del
Nov 15 06:02:24 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Deletion of /opt/stack/data/nova/instances/6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb_del complete
Nov 15 06:02:24 user nova-compute[75648]: INFO nova.compute.manager [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 15 06:02:24 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:24 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Took 0.63 seconds to deallocate network for instance.
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5106d915-b323-420e-98ef-8ee11a67cf05 req-c03106ee-5310-42dd-aef4-8c4a27f3764b service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-vif-deleted-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:24 user nova-compute[75648]: INFO nova.compute.manager [req-5106d915-b323-420e-98ef-8ee11a67cf05 req-c03106ee-5310-42dd-aef4-8c4a27f3764b service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Neutron deleted interface 91befc9d-8f30-4e55-a8d1-133756c3a773; detaching it from the instance and deleting it from the info cache
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.network.neutron [req-5106d915-b323-420e-98ef-8ee11a67cf05 req-c03106ee-5310-42dd-aef4-8c4a27f3764b service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-5106d915-b323-420e-98ef-8ee11a67cf05 req-c03106ee-5310-42dd-aef4-8c4a27f3764b service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Detach interface failed, port_id=91befc9d-8f30-4e55-a8d1-133756c3a773, reason: Instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.251s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:25 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Deleted allocations for instance 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb
Nov 15 06:02:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c4c88a75-1804-4197-a3cf-d5e7ef6617fa tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.115s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-6711abb1-ae9b-4ed2-b1c4-b8ee166b1336 req-d495d6dd-d391-4cf4-9ba6-4998ed2ae793 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received event network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6711abb1-ae9b-4ed2-b1c4-b8ee166b1336 req-d495d6dd-d391-4cf4-9ba6-4998ed2ae793 service nova] Acquiring lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6711abb1-ae9b-4ed2-b1c4-b8ee166b1336 req-d495d6dd-d391-4cf4-9ba6-4998ed2ae793 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6711abb1-ae9b-4ed2-b1c4-b8ee166b1336 req-d495d6dd-d391-4cf4-9ba6-4998ed2ae793 service nova] Lock "6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:25 user nova-compute[75648]: DEBUG nova.compute.manager [req-6711abb1-ae9b-4ed2-b1c4-b8ee166b1336 req-d495d6dd-d391-4cf4-9ba6-4998ed2ae793 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] No waiting events found dispatching network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:25 user nova-compute[75648]: WARNING nova.compute.manager [req-6711abb1-ae9b-4ed2-b1c4-b8ee166b1336 req-d495d6dd-d391-4cf4-9ba6-4998ed2ae793 service nova] [instance: 6bbcd68c-fc0f-471c-b0ca-4aa0d9ff38eb] Received unexpected event network-vif-plugged-91befc9d-8f30-4e55-a8d1-133756c3a773 for instance with vm_state deleted and task_state None.
Nov 15 06:02:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "83800282-646d-4f80-b957-cbd79c2d4d05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:54 user nova-compute[75648]: INFO nova.compute.manager [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Terminating instance
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-cb0ad95a-4500-48dd-99bf-ac736e1ee3fa req-1757318a-d490-47df-96ec-e633d036bd6a service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-vif-unplugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cb0ad95a-4500-48dd-99bf-ac736e1ee3fa req-1757318a-d490-47df-96ec-e633d036bd6a service nova] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cb0ad95a-4500-48dd-99bf-ac736e1ee3fa req-1757318a-d490-47df-96ec-e633d036bd6a service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-cb0ad95a-4500-48dd-99bf-ac736e1ee3fa req-1757318a-d490-47df-96ec-e633d036bd6a service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-cb0ad95a-4500-48dd-99bf-ac736e1ee3fa req-1757318a-d490-47df-96ec-e633d036bd6a service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] No waiting events found dispatching network-vif-unplugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.compute.manager [req-cb0ad95a-4500-48dd-99bf-ac736e1ee3fa req-1757318a-d490-47df-96ec-e633d036bd6a service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-vif-unplugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Instance destroyed successfully.
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lazy-loading 'resources' on Instance uuid 83800282-646d-4f80-b957-cbd79c2d4d05 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1425371564',display_name='tempest-VolumesNegativeTest-instance-1425371564',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1425371564',id=48,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77e850a175a24f2da81c82356262dfe5',ramdisk_id='',reservation_id='r-0kbp3q8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1922897537',owner_user_name='tempest-VolumesNegativeTest-1922897537-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:01:11Z,user_data=None,user_id='e0a62de05d1849c5a3f156644a055ab8',uuid=83800282-646d-4f80-b957-cbd79c2d4d05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Converting VIF {"id": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "address": "fa:16:3e:ce:bb:fd", "network": {"id": "68369c29-df99-4cbe-a6cc-029cc275a55d", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.150", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c469ae6196ba4f5aa645e12724f2389d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e63cbcd-13", "ovs_interfaceid": "6e63cbcd-13a3-461b-939c-33127d04cfa9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG os_vif [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e63cbcd-13, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09dc7089-f038-4890-8fb9-037daeda07de) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:54 user nova-compute[75648]: INFO os_vif [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:bb:fd,bridge_name='br-int',has_traffic_filtering=True,id=6e63cbcd-13a3-461b-939c-33127d04cfa9,network=Network(68369c29-df99-4cbe-a6cc-029cc275a55d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6e63cbcd-13')
Nov 15 06:02:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Deleting instance files /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05_del
Nov 15 06:02:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Deletion of /opt/stack/data/nova/instances/83800282-646d-4f80-b957-cbd79c2d4d05_del complete
Nov 15 06:02:54 user nova-compute[75648]: INFO nova.compute.manager [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 06:02:54 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:02:54 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:55 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Took 0.39 seconds to deallocate network for instance.
Nov 15 06:02:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-a3e43eb8-394c-4795-99eb-65b18bad20bf req-cde124d2-1c61-41f2-8253-6e8aed530ef1 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-vif-deleted-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:55 user nova-compute[75648]: INFO nova.compute.manager [req-a3e43eb8-394c-4795-99eb-65b18bad20bf req-cde124d2-1c61-41f2-8253-6e8aed530ef1 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Neutron deleted interface 6e63cbcd-13a3-461b-939c-33127d04cfa9; detaching it from the instance and deleting it from the info cache
Nov 15 06:02:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-a3e43eb8-394c-4795-99eb-65b18bad20bf req-cde124d2-1c61-41f2-8253-6e8aed530ef1 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-a3e43eb8-394c-4795-99eb-65b18bad20bf req-cde124d2-1c61-41f2-8253-6e8aed530ef1 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Detach interface failed, port_id=6e63cbcd-13a3-461b-939c-33127d04cfa9, reason: Instance 83800282-646d-4f80-b957-cbd79c2d4d05 could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:02:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:55 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Deleted allocations for instance 83800282-646d-4f80-b957-cbd79c2d4d05
Nov 15 06:02:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e9069d4-bfbd-4510-84dc-3d0bdaedb2d0 tempest-VolumesNegativeTest-1922897537 tempest-VolumesNegativeTest-1922897537-project-member] Lock "83800282-646d-4f80-b957-cbd79c2d4d05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.428s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-86f7e436-77d8-41cd-8bd5-de5bdfc85759 req-9d5d1919-00b9-4d1a-ae70-3f8cedb89ed2 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received event network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:02:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-86f7e436-77d8-41cd-8bd5-de5bdfc85759 req-9d5d1919-00b9-4d1a-ae70-3f8cedb89ed2 service nova] Acquiring lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:02:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-86f7e436-77d8-41cd-8bd5-de5bdfc85759 req-9d5d1919-00b9-4d1a-ae70-3f8cedb89ed2 service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:02:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-86f7e436-77d8-41cd-8bd5-de5bdfc85759 req-9d5d1919-00b9-4d1a-ae70-3f8cedb89ed2 service nova] Lock "83800282-646d-4f80-b957-cbd79c2d4d05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:02:56 user nova-compute[75648]: DEBUG nova.compute.manager [req-86f7e436-77d8-41cd-8bd5-de5bdfc85759 req-9d5d1919-00b9-4d1a-ae70-3f8cedb89ed2 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] No waiting events found dispatching network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:02:56 user nova-compute[75648]: WARNING nova.compute.manager [req-86f7e436-77d8-41cd-8bd5-de5bdfc85759 req-9d5d1919-00b9-4d1a-ae70-3f8cedb89ed2 service nova] [instance: 83800282-646d-4f80-b957-cbd79c2d4d05] Received unexpected event network-vif-plugged-6e63cbcd-13a3-461b-939c-33127d04cfa9 for instance with vm_state deleted and task_state None.
Nov 15 06:02:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:02:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:03:07 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:03:08 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8796MB free_disk=25.218921661376953GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Applying migration context for instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 as it has an incoming, in-progress migration 16496fce-e1f9-4226-9bec-bff641cd6222. Migration status is finished {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 15 06:03:08 user nova-compute[75648]: INFO nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating resource usage from migration 16496fce-e1f9-4226-9bec-bff641cd6222
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.network.neutron [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'info_cache' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Migration 16496fce-e1f9-4226-9bec-bff641cd6222 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:03:08 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:03:09 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance destroyed successfully.
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'resources' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG os_vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8420ab57-d9, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48ba7398-e477-47c7-84d5-f4d7d3c72c6e) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:09 user nova-compute[75648]: INFO os_vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9')
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start _get_guest_xml network_info=[{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'numa_topology' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:03:09 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:03:09 user nova-compute[75648]:   <uuid>8e6eb152-51f0-41a8-9d32-2b1e3831582b</uuid>
Nov 15 06:03:09 user nova-compute[75648]:   <name>instance-0000002b</name>
Nov 15 06:03:09 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:03:09 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:03:09 user nova-compute[75648]:   <metadata>
Nov 15 06:03:09 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:03:09 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:03:09 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeTestJSON-server-2058775542</nova:name>
Nov 15 06:03:09 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:03:09</nova:creationTime>
Nov 15 06:03:09 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:03:09 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:03:09 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:03:09 user nova-compute[75648]:       <nova:owner>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:user uuid="5fdcc2d55067412ba64925df1b9ef0e5">tempest-AttachVolumeTestJSON-1331007260-project-member</nova:user>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:project uuid="eb230cb5a30941d5b1901713c9082bfa">tempest-AttachVolumeTestJSON-1331007260</nova:project>
Nov 15 06:03:09 user nova-compute[75648]:       </nova:owner>
Nov 15 06:03:09 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 06:03:09 user nova-compute[75648]:       <nova:ports>
Nov 15 06:03:09 user nova-compute[75648]:         <nova:port uuid="8420ab57-d939-403c-8051-094cc2dc2e76">
Nov 15 06:03:09 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 06:03:09 user nova-compute[75648]:         </nova:port>
Nov 15 06:03:09 user nova-compute[75648]:       </nova:ports>
Nov 15 06:03:09 user nova-compute[75648]:     </nova:instance>
Nov 15 06:03:09 user nova-compute[75648]:   </metadata>
Nov 15 06:03:09 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:03:09 user nova-compute[75648]:     <system>
Nov 15 06:03:09 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:03:09 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:03:09 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:03:09 user nova-compute[75648]:       <entry name="serial">8e6eb152-51f0-41a8-9d32-2b1e3831582b</entry>
Nov 15 06:03:09 user nova-compute[75648]:       <entry name="uuid">8e6eb152-51f0-41a8-9d32-2b1e3831582b</entry>
Nov 15 06:03:09 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:03:09 user nova-compute[75648]:     </system>
Nov 15 06:03:09 user nova-compute[75648]:   </sysinfo>
Nov 15 06:03:09 user nova-compute[75648]:   <os>
Nov 15 06:03:09 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:03:09 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:03:09 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:03:09 user nova-compute[75648]:   </os>
Nov 15 06:03:09 user nova-compute[75648]:   <features>
Nov 15 06:03:09 user nova-compute[75648]:     <acpi/>
Nov 15 06:03:09 user nova-compute[75648]:     <apic/>
Nov 15 06:03:09 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:03:09 user nova-compute[75648]:   </features>
Nov 15 06:03:09 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:03:09 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:03:09 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:03:09 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:03:09 user nova-compute[75648]:   </clock>
Nov 15 06:03:09 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:03:09 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:03:09 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:03:09 user nova-compute[75648]:   </cpu>
Nov 15 06:03:09 user nova-compute[75648]:   <devices>
Nov 15 06:03:09 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 06:03:09 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 06:03:09 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk"/>
Nov 15 06:03:09 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:03:09 user nova-compute[75648]:     </disk>
Nov 15 06:03:09 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:03:09 user nova-compute[75648]:       <mac address="fa:16:3e:09:b5:d1"/>
Nov 15 06:03:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:03:09 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:03:09 user nova-compute[75648]:       <target dev="tap8420ab57-d9"/>
Nov 15 06:03:09 user nova-compute[75648]:     </interface>
Nov 15 06:03:09 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:03:09 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/console.log" append="off"/>
Nov 15 06:03:09 user nova-compute[75648]:     </serial>
Nov 15 06:03:09 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:03:09 user nova-compute[75648]:     <video>
Nov 15 06:03:09 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:03:09 user nova-compute[75648]:     </video>
Nov 15 06:03:09 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:03:09 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:03:09 user nova-compute[75648]:     </rng>
Nov 15 06:03:09 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:03:09 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:03:09 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:03:09 user nova-compute[75648]:     </memballoon>
Nov 15 06:03:09 user nova-compute[75648]:   </devices>
Nov 15 06:03:09 user nova-compute[75648]: </domain>
Nov 15 06:03:09 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid b955533a-d29e-4a8f-9c8e-7da7ae052eae {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Cannot resize image /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.objects.instance [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'migration_context' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.objects.base [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Object Instance<8e6eb152-51f0-41a8-9d32-2b1e3831582b> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:01:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG os_vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3a358a64-3f7f-5431-9a1a-990000365f49', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8420ab57-d9, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8420ab57-d9, col_values=(('qos', UUID('3ef7146a-b1ef-4216-b7a9-47d111013b64')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8420ab57-d9, col_values=(('external_ids', {'iface-id': '8420ab57-d939-403c-8051-094cc2dc2e76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:b5:d1', 'vm-uuid': '8e6eb152-51f0-41a8-9d32-2b1e3831582b'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:10 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:10 user nova-compute[75648]: INFO os_vif [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9')
Nov 15 06:03:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-45c02a69-ec11-4099-ac23-c3856602d7df req-d2b77963-1db5-41b6-bdbe-1468d0359873 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-45c02a69-ec11-4099-ac23-c3856602d7df req-d2b77963-1db5-41b6-bdbe-1468d0359873 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-45c02a69-ec11-4099-ac23-c3856602d7df req-d2b77963-1db5-41b6-bdbe-1468d0359873 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-45c02a69-ec11-4099-ac23-c3856602d7df req-d2b77963-1db5-41b6-bdbe-1468d0359873 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG nova.compute.manager [req-45c02a69-ec11-4099-ac23-c3856602d7df req-d2b77963-1db5-41b6-bdbe-1468d0359873 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:03:12 user nova-compute[75648]: WARNING nova.compute.manager [req-45c02a69-ec11-4099-ac23-c3856602d7df req-d2b77963-1db5-41b6-bdbe-1468d0359873 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state stopped and task_state powering-on.
Nov 15 06:03:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:03:12 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:03:13 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance rebooted successfully.
Nov 15 06:03:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-3e676a3c-01ec-4bed-a306-be63a8cbe8c7 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:03:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-9727f9ac-04dd-48ca-bdc1-db9543df6aae req-dda876dd-3055-4245-b0bd-5292785caf5d service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:03:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9727f9ac-04dd-48ca-bdc1-db9543df6aae req-dda876dd-3055-4245-b0bd-5292785caf5d service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9727f9ac-04dd-48ca-bdc1-db9543df6aae req-dda876dd-3055-4245-b0bd-5292785caf5d service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-9727f9ac-04dd-48ca-bdc1-db9543df6aae req-dda876dd-3055-4245-b0bd-5292785caf5d service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:14 user nova-compute[75648]: DEBUG nova.compute.manager [req-9727f9ac-04dd-48ca-bdc1-db9543df6aae req-dda876dd-3055-4245-b0bd-5292785caf5d service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:03:14 user nova-compute[75648]: WARNING nova.compute.manager [req-9727f9ac-04dd-48ca-bdc1-db9543df6aae req-dda876dd-3055-4245-b0bd-5292785caf5d service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state active and task_state None.
Nov 15 06:03:15 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 06:03:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:16 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:03:16 user nova-compute[75648]: INFO nova.compute.claims [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Claim successful on node user
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.311s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 06:03:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.policy [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f995cb1428a414d91dd043e1c53d130', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06304608934649daab8dc8e603b9a446', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 06:03:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Creating image(s)
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "/opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "/opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.186s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk 1073741824" returned: 0 in 0.057s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Successfully created port: 1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.183s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 06:03:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Cannot resize image /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Ensure instance console log exists: /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Successfully updated port: 1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquired lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-changed-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.compute.manager [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Refreshing instance network info cache due to event network-changed-1e5eae51-f4ea-4a81-bed2-e370afedd1b1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] Acquiring lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updating instance_info_cache with network_info: [{"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Releasing lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Instance network_info: |[{"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] Acquired lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.neutron [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Refreshing network info cache for port 1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Start _get_guest_xml network_info=[{"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:03:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:03:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-861283748',display_name='tempest-AttachVolumeNegativeTest-server-861283748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-861283748',id=49,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLestBxtGmYVsALSSF3fvZctRhNKPsy4wynq04UZU6yUIoN9krnup7pD/v9bOg7+CHtx1gXvaetw7yR/PmJlDR92XTJDDFVIVKyixvc+2sreBYt6fK0tKNW9XlHGCW5CiA==',key_name='tempest-keypair-1568807904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-3sn5jlgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=c34a321d-5e9e-48d4-b64c-052897369754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'pci_devices' on Instance uuid c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:03:18 user nova-compute[75648]:   <uuid>c34a321d-5e9e-48d4-b64c-052897369754</uuid>
Nov 15 06:03:18 user nova-compute[75648]:   <name>instance-00000031</name>
Nov 15 06:03:18 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:03:18 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:03:18 user nova-compute[75648]:   <metadata>
Nov 15 06:03:18 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:03:18 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:03:18 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeNegativeTest-server-861283748</nova:name>
Nov 15 06:03:18 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:03:18</nova:creationTime>
Nov 15 06:03:18 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:03:18 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:03:18 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:03:18 user nova-compute[75648]:       <nova:owner>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:user uuid="8f995cb1428a414d91dd043e1c53d130">tempest-AttachVolumeNegativeTest-2114996187-project-member</nova:user>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:project uuid="06304608934649daab8dc8e603b9a446">tempest-AttachVolumeNegativeTest-2114996187</nova:project>
Nov 15 06:03:18 user nova-compute[75648]:       </nova:owner>
Nov 15 06:03:18 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 06:03:18 user nova-compute[75648]:       <nova:ports>
Nov 15 06:03:18 user nova-compute[75648]:         <nova:port uuid="1e5eae51-f4ea-4a81-bed2-e370afedd1b1">
Nov 15 06:03:18 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 15 06:03:18 user nova-compute[75648]:         </nova:port>
Nov 15 06:03:18 user nova-compute[75648]:       </nova:ports>
Nov 15 06:03:18 user nova-compute[75648]:     </nova:instance>
Nov 15 06:03:18 user nova-compute[75648]:   </metadata>
Nov 15 06:03:18 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:03:18 user nova-compute[75648]:     <system>
Nov 15 06:03:18 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:03:18 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:03:18 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:03:18 user nova-compute[75648]:       <entry name="serial">c34a321d-5e9e-48d4-b64c-052897369754</entry>
Nov 15 06:03:18 user nova-compute[75648]:       <entry name="uuid">c34a321d-5e9e-48d4-b64c-052897369754</entry>
Nov 15 06:03:18 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:03:18 user nova-compute[75648]:     </system>
Nov 15 06:03:18 user nova-compute[75648]:   </sysinfo>
Nov 15 06:03:18 user nova-compute[75648]:   <os>
Nov 15 06:03:18 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:03:18 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:03:18 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:03:18 user nova-compute[75648]:   </os>
Nov 15 06:03:18 user nova-compute[75648]:   <features>
Nov 15 06:03:18 user nova-compute[75648]:     <acpi/>
Nov 15 06:03:18 user nova-compute[75648]:     <apic/>
Nov 15 06:03:18 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:03:18 user nova-compute[75648]:   </features>
Nov 15 06:03:18 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:03:18 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:03:18 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:03:18 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:03:18 user nova-compute[75648]:   </clock>
Nov 15 06:03:18 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:03:18 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:03:18 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:03:18 user nova-compute[75648]:   </cpu>
Nov 15 06:03:18 user nova-compute[75648]:   <devices>
Nov 15 06:03:18 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 06:03:18 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 06:03:18 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk"/>
Nov 15 06:03:18 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:03:18 user nova-compute[75648]:     </disk>
Nov 15 06:03:18 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:03:18 user nova-compute[75648]:       <mac address="fa:16:3e:45:67:fd"/>
Nov 15 06:03:18 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:03:18 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:03:18 user nova-compute[75648]:       <target dev="tap1e5eae51-f4"/>
Nov 15 06:03:18 user nova-compute[75648]:     </interface>
Nov 15 06:03:18 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:03:18 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/console.log" append="off"/>
Nov 15 06:03:18 user nova-compute[75648]:     </serial>
Nov 15 06:03:18 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:03:18 user nova-compute[75648]:     <video>
Nov 15 06:03:18 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:03:18 user nova-compute[75648]:     </video>
Nov 15 06:03:18 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:03:18 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:03:18 user nova-compute[75648]:     </rng>
Nov 15 06:03:18 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:03:18 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:03:18 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:03:18 user nova-compute[75648]:     </memballoon>
Nov 15 06:03:18 user nova-compute[75648]:   </devices>
Nov 15 06:03:18 user nova-compute[75648]: </domain>
Nov 15 06:03:18 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-861283748',display_name='tempest-AttachVolumeNegativeTest-server-861283748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-861283748',id=49,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLestBxtGmYVsALSSF3fvZctRhNKPsy4wynq04UZU6yUIoN9krnup7pD/v9bOg7+CHtx1gXvaetw7yR/PmJlDR92XTJDDFVIVKyixvc+2sreBYt6fK0tKNW9XlHGCW5CiA==',key_name='tempest-keypair-1568807904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-3sn5jlgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:03:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=c34a321d-5e9e-48d4-b64c-052897369754,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG os_vif [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef910d4d-1714-5863-a9ab-70f6c6363c55', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e5eae51-f4, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e5eae51-f4, col_values=(('qos', UUID('09cfaf67-13d9-4b1c-9767-a49fe8bd8ebb')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e5eae51-f4, col_values=(('external_ids', {'iface-id': '1e5eae51-f4ea-4a81-bed2-e370afedd1b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:67:fd', 'vm-uuid': 'c34a321d-5e9e-48d4-b64c-052897369754'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: INFO os_vif [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4')
Nov 15 06:03:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:03:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:45:67:fd, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:03:19 user nova-compute[75648]: DEBUG nova.network.neutron [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updated VIF entry in instance network info cache for port 1e5eae51-f4ea-4a81-bed2-e370afedd1b1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:03:19 user nova-compute[75648]: DEBUG nova.network.neutron [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updating instance_info_cache with network_info: [{"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:03:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5e4708f8-7cd6-4ea4-85f4-c03a56e57871 req-389c585c-8228-4826-b2f5-5d60345be690 service nova] Releasing lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-c57bdf69-c142-4254-96ee-48fe196da86c req-b6c1fb80-6240-4c6e-9a44-8e6a4a7067cc service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c57bdf69-c142-4254-96ee-48fe196da86c req-b6c1fb80-6240-4c6e-9a44-8e6a4a7067cc service nova] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c57bdf69-c142-4254-96ee-48fe196da86c req-b6c1fb80-6240-4c6e-9a44-8e6a4a7067cc service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c57bdf69-c142-4254-96ee-48fe196da86c req-b6c1fb80-6240-4c6e-9a44-8e6a4a7067cc service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG nova.compute.manager [req-c57bdf69-c142-4254-96ee-48fe196da86c req-b6c1fb80-6240-4c6e-9a44-8e6a4a7067cc service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] No waiting events found dispatching network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:03:20 user nova-compute[75648]: WARNING nova.compute.manager [req-c57bdf69-c142-4254-96ee-48fe196da86c req-b6c1fb80-6240-4c6e-9a44-8e6a4a7067cc service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received unexpected event network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 for instance with vm_state building and task_state spawning.
Nov 15 06:03:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 06:03:22 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Instance spawned successfully.
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:03:22 user nova-compute[75648]: INFO nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Took 5.08 seconds to spawn the instance on the hypervisor.
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:03:22 user nova-compute[75648]: INFO nova.compute.manager [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Took 5.75 seconds to build instance.
Nov 15 06:03:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c62f7e28-e09f-4459-8bd0-4ad31ca8e26a tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.836s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-88831484-6ce9-4bb2-9812-6db99d38bbac req-26a8d591-90b6-4192-8af5-2a5e89530b53 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-88831484-6ce9-4bb2-9812-6db99d38bbac req-26a8d591-90b6-4192-8af5-2a5e89530b53 service nova] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-88831484-6ce9-4bb2-9812-6db99d38bbac req-26a8d591-90b6-4192-8af5-2a5e89530b53 service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-88831484-6ce9-4bb2-9812-6db99d38bbac req-26a8d591-90b6-4192-8af5-2a5e89530b53 service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-88831484-6ce9-4bb2-9812-6db99d38bbac req-26a8d591-90b6-4192-8af5-2a5e89530b53 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] No waiting events found dispatching network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:03:22 user nova-compute[75648]: WARNING nova.compute.manager [req-88831484-6ce9-4bb2-9812-6db99d38bbac req-26a8d591-90b6-4192-8af5-2a5e89530b53 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received unexpected event network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 for instance with vm_state active and task_state None.
Nov 15 06:03:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:26 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:03:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Going to confirm migration 2 {{(pid=75648) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'info_cache' on Instance uuid 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'migration_context' on Instance uuid 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG nova.objects.base [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Object Instance<23e250a1-2c65-4ba1-b8d8-09cf4334ad44> lazy-loaded attributes: info_cache,migration_context {{(pid=75648) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:03:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.252s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:49 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Deleted allocation for migration 16496fce-e1f9-4226-9bec-bff641cd6222
Nov 15 06:03:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f8575941-160c-436d-a8e2-c52daa2e7803 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.176s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:03:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:03:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:04:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:09 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:09 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:04:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:04:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:04:09 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [{"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-8e6eb152-51f0-41a8-9d32-2b1e3831582b" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:04:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:04:11 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:04:11 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8531MB free_disk=25.17162322998047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c34a321d-5e9e-48d4-b64c-052897369754 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:04:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:04:12 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:04:12 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:04:12 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:04:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:04:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:04:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:04:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:04:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:04:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:04:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:04:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:04:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:04:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:04:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:04:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:00 user nova-compute[75648]: INFO nova.compute.manager [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Terminating instance
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-facf3165-2827-42ce-892b-be6f8c8dd395 req-54baeab5-cacc-4804-88b8-fd3f65242b19 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-facf3165-2827-42ce-892b-be6f8c8dd395 req-54baeab5-cacc-4804-88b8-fd3f65242b19 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-facf3165-2827-42ce-892b-be6f8c8dd395 req-54baeab5-cacc-4804-88b8-fd3f65242b19 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-facf3165-2827-42ce-892b-be6f8c8dd395 req-54baeab5-cacc-4804-88b8-fd3f65242b19 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-facf3165-2827-42ce-892b-be6f8c8dd395 req-54baeab5-cacc-4804-88b8-fd3f65242b19 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.compute.manager [req-facf3165-2827-42ce-892b-be6f8c8dd395 req-54baeab5-cacc-4804-88b8-fd3f65242b19 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-unplugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:05:00 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Instance destroyed successfully.
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'resources' on Instance uuid 8e6eb152-51f0-41a8-9d32-2b1e3831582b {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:55:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-2058775542',display_name='tempest-AttachVolumeTestJSON-server-2058775542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-2058775542',id=43,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEQizmPKA5IF1O9URdrFM8TTuK1aHMxQeR1jsNl4QOgmZU6t9hx8RiTBxYibNZT+iWjfOUrKnqwxqvXazPq4kZCbeBkhNLe9eGypJLuELHhzdWhEHpYaJYj6yFSVvFelUA==',key_name='tempest-keypair-1953263267',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:55:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-0nlf33y1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:03:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=8e6eb152-51f0-41a8-9d32-2b1e3831582b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "8420ab57-d939-403c-8051-094cc2dc2e76", "address": "fa:16:3e:09:b5:d1", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8420ab57-d9", "ovs_interfaceid": "8420ab57-d939-403c-8051-094cc2dc2e76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG os_vif [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8420ab57-d9, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:00 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3ef7146a-b1ef-4216-b7a9-47d111013b64) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:01 user nova-compute[75648]: INFO os_vif [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:b5:d1,bridge_name='br-int',has_traffic_filtering=True,id=8420ab57-d939-403c-8051-094cc2dc2e76,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8420ab57-d9')
Nov 15 06:05:01 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Deleting instance files /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b_del
Nov 15 06:05:01 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Deletion of /opt/stack/data/nova/instances/8e6eb152-51f0-41a8-9d32-2b1e3831582b_del complete
Nov 15 06:05:01 user nova-compute[75648]: INFO nova.compute.manager [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 15 06:05:01 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:05:01 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:05:01 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:05:01 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:05:01 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Took 0.91 seconds to deallocate network for instance.
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-5edc220b-ecae-4dc9-8963-24dafd58c674 req-12b2f5ac-7ea1-48af-90ae-0d0a41d53fc7 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-deleted-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:02 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Deleted allocations for instance 8e6eb152-51f0-41a8-9d32-2b1e3831582b
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b516f488-c694-4969-8c17-501d9f528241 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.959s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-c860aaa9-4aa3-4443-b125-7fdf5fd19a70 req-2f595ed9-590c-4171-8077-6bf94ab50766 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c860aaa9-4aa3-4443-b125-7fdf5fd19a70 req-2f595ed9-590c-4171-8077-6bf94ab50766 service nova] Acquiring lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c860aaa9-4aa3-4443-b125-7fdf5fd19a70 req-2f595ed9-590c-4171-8077-6bf94ab50766 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-c860aaa9-4aa3-4443-b125-7fdf5fd19a70 req-2f595ed9-590c-4171-8077-6bf94ab50766 service nova] Lock "8e6eb152-51f0-41a8-9d32-2b1e3831582b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:02 user nova-compute[75648]: DEBUG nova.compute.manager [req-c860aaa9-4aa3-4443-b125-7fdf5fd19a70 req-2f595ed9-590c-4171-8077-6bf94ab50766 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] No waiting events found dispatching network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:05:02 user nova-compute[75648]: WARNING nova.compute.manager [req-c860aaa9-4aa3-4443-b125-7fdf5fd19a70 req-2f595ed9-590c-4171-8077-6bf94ab50766 service nova] [instance: 8e6eb152-51f0-41a8-9d32-2b1e3831582b] Received unexpected event network-vif-plugged-8420ab57-d939-403c-8051-094cc2dc2e76 for instance with vm_state deleted and task_state None.
Nov 15 06:05:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:05 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-changed-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG nova.compute.manager [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Refreshing instance network info cache due to event network-changed-1e5eae51-f4ea-4a81-bed2-e370afedd1b1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] Acquiring lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] Acquired lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Refreshing network info cache for port 1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updated VIF entry in instance network info cache for port 1e5eae51-f4ea-4a81-bed2-e370afedd1b1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:05:07 user nova-compute[75648]: DEBUG nova.network.neutron [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updating instance_info_cache with network_info: [{"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:05:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-ca1baa74-fa84-47db-90ec-4f607686eb3c req-2b80e940-a325-421e-a34a-b6e00e645f20 service nova] Releasing lock "refresh_cache-c34a321d-5e9e-48d4-b64c-052897369754" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:05:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG nova.objects.instance [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:09 user nova-compute[75648]: INFO nova.compute.manager [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Attaching volume 92877465-16cd-41c0-879e-aa9fc7d5aadb to /dev/vdb
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG os_brick.utils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[88253310-16c1-4f81-a997-de563aaa5bb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[44097188-a4c7-4bc3-bd51-a97d9129feaa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ebcff-7ea0-46f5-84ee-76e341b9ad9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[717412f1-f3d0-43ac-a189-290e71a63ed0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:05:09 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba2061c-a573-4131-85a7-a199ddaaffc1]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG os_brick.utils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updating existing volume attachment record: a9e9e4be-5446-4dc4-9e18-15c9ad6a2a8e {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:09 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:10 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:05:10 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:05:10 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8781MB free_disk=25.198333740234375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance c34a321d-5e9e-48d4-b64c-052897369754 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.573s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [{"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-23e250a1-2c65-4ba1-b8d8-09cf4334ad44" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:05:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REXaqLfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:05:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:05:14 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:05:14 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[06b97ff9-51be-4d8f-a320-6fa679c83a04]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:05:14 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4006f8d2-67a7-492d-b274-508a924b45aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb] added
Nov 15 06:05:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc39f425-b2df-4858-82d7-a9cdfc7d3b48]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8d84eb-efa2-4c7e-b185-3cb059de22e0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REXaqLfw {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REXaqLfw" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6955aa5-ec7e-4937-903f-cfca7c318ed6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REXaqLfw'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a459dd6c-5e23-4819-b76f-970c5327febf]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e48612-a7f1-4904-be8f-d1dfdfc9c687]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:05:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:05:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f29e87-4d2c-4675-8618-cc7518d2dc84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260]
Nov 15 06:05:14 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260] successful.
Nov 15 06:05:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[777102e5-a5fe-4a76-8543-26eac3d8757a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1729aaa5-07e3-4173-abe7-4ebd4d5751fa]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:05:14 user nova-compute[75648]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb (non-flash)
Nov 15 06:05:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:05:14 user nova-compute[75648]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb (non-flash)
Nov 15 06:05:14 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[177403c5-92c8-4e78-9e92-3c36fbf13ba9]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:14 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REXaqLfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23130363134656238', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130363134656238', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG nova.objects.instance [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:05:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:05:15 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:05:15 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:05:15 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:05:15 user nova-compute[75648]:   <serial>92877465-16cd-41c0-879e-aa9fc7d5aadb</serial>
Nov 15 06:05:15 user nova-compute[75648]: </disk>
Nov 15 06:05:15 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:05:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:05:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:05:16 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] No VIF found with MAC fa:16:3e:45:67:fd, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:05:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-db9bf48c-ec60-4043-adef-ea0c19d55fe6 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.746s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:17 user nova-compute[75648]: INFO nova.compute.manager [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Detaching volume 92877465-16cd-41c0-879e-aa9fc7d5aadb
Nov 15 06:05:17 user nova-compute[75648]: INFO nova.virt.block_device [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Attempting to driver detach volume 92877465-16cd-41c0-879e-aa9fc7d5aadb from mountpoint /dev/vdb
Nov 15 06:05:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Attempting to detach device vdb from instance c34a321d-5e9e-48d4-b64c-052897369754 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:05:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:05:17 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:05:17 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:05:17 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:05:17 user nova-compute[75648]:   <serial>92877465-16cd-41c0-879e-aa9fc7d5aadb</serial>
Nov 15 06:05:17 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:05:17 user nova-compute[75648]: </disk>
Nov 15 06:05:17 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:05:17 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully detached device vdb from instance c34a321d-5e9e-48d4-b64c-052897369754 from the persistent domain config.
Nov 15 06:05:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c34a321d-5e9e-48d4-b64c-052897369754 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:05:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:05:17 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:05:17 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:05:17 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:05:17 user nova-compute[75648]:   <serial>92877465-16cd-41c0-879e-aa9fc7d5aadb</serial>
Nov 15 06:05:17 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:05:17 user nova-compute[75648]: </disk>
Nov 15 06:05:17 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:05:17 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:05:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 06:05:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:26 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:27 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_power_states {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid b955533a-d29e-4a8f-9c8e-7da7ae052eae {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Triggering sync for uuid c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:29 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:05:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:37 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c34a321d-5e9e-48d4-b64c-052897369754 is timed out.
Nov 15 06:05:37 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully detached device vdb from instance c34a321d-5e9e-48d4-b64c-052897369754 from the live domain config.
Nov 15 06:05:37 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REXaqLfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:05:37 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:05:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1784ee6b-670d-4102-a1ef-2f6031c60daf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:05:37 user nova-compute[75648]: No targets found.
Nov 15 06:05:37 user nova-compute[75648]: iSNS:
Nov 15 06:05:37 user nova-compute[75648]: No targets found.
Nov 15 06:05:37 user nova-compute[75648]: STATIC:
Nov 15 06:05:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:05:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:05:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:05:37 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb
Nov 15 06:05:37 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:05:37 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:05:37 user nova-compute[75648]: FIRMWARE:
Nov 15 06:05:37 user nova-compute[75648]: No targets found.
Nov 15 06:05:37 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:05:37 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:05:37 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:05:37 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed46b2ea-5034-4739-a0ea-71c628e068f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[00ca367b-f833-4608-88d5-756dbb87f2aa]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:05:38 user nova-compute[75648]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb (non-flash)
Nov 15 06:05:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:05:38 user nova-compute[75648]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb (non-flash)
Nov 15 06:05:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c457ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fbfc4-20f2-4fa1-85cd-300fcae348a5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[55c2b95b-1ed5-4fd3-962e-47b15500acff]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe97ed2-fb72-4ee6-8516-aa83475a73c6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c6ab65-dea3-4bed-9cf7-807f4168d616]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c91607f-c287-4b6f-9d60-70c5a80941f6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76d5724-b658-444b-b7e9-fb31feee9506]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260]
Nov 15 06:05:38 user nova-compute[75648]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb, portal: 172.16.0.220,3260] successful.
Nov 15 06:05:38 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:92877465-16cd-41c0-879e-aa9fc7d5aadb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3a1462-385a-46bf-9c8c-1ecc53d175b9]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] <== disconnect_volume: return (309ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:05:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:05:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:39 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'flavor' on Instance uuid c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:05:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c38388cf-9b2e-4133-b926-b97473bab4b2 tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.598s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c34a321d-5e9e-48d4-b64c-052897369754" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.397s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "c34a321d-5e9e-48d4-b64c-052897369754" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:39 user nova-compute[75648]: INFO nova.compute.manager [None req-104b8ec8-fc1e-4ff9-b862-8e4193918564 tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Get console output
Nov 15 06:05:39 user nova-compute[75648]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 15 06:05:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:50 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:53 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:05:54 user nova-compute[75648]: INFO nova.compute.claims [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Claim successful on node user
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.network.neutron [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 06:05:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.policy [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5fdcc2d55067412ba64925df1b9ef0e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb230cb5a30941d5b1901713c9082bfa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 06:05:54 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Creating image(s)
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "/opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "/opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "/opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk 1073741824" returned: 0 in 0.055s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Successfully created port: 9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Cannot resize image /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Ensure instance console log exists: /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Successfully updated port: 9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquired lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-changed-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.compute.manager [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Refreshing instance network info cache due to event network-changed-9ddff292-9582-4690-a572-45c807efa5d1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] Acquiring lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.network.neutron [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Releasing lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Instance network_info: |[{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] Acquired lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.network.neutron [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Refreshing network info cache for port 9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Start _get_guest_xml network_info=[{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:05:55 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:05:55 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:05:55 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-906006999',display_name='tempest-AttachVolumeTestJSON-server-906006999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-906006999',id=50,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkb0Il8UgQKA30sqFCWgjs7aqlVXLUz22sYvVIa2l5sPwz1QBH5HjMQNoRb5feKtUAWcYZk5+/1vvAJvhinFhGoWcp9PFCRivFfNsSQ37bS5ibFq6yKnCFNgyGXtu/Ehw==',key_name='tempest-keypair-1765136208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-ia946nzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=eafad801-651a-4e91-a5dd-a925b9b7956e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.objects.instance [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'pci_devices' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:05:56 user nova-compute[75648]:   <uuid>eafad801-651a-4e91-a5dd-a925b9b7956e</uuid>
Nov 15 06:05:56 user nova-compute[75648]:   <name>instance-00000032</name>
Nov 15 06:05:56 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:05:56 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:05:56 user nova-compute[75648]:   <metadata>
Nov 15 06:05:56 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:05:56 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:05:56 user nova-compute[75648]:       <nova:name>tempest-AttachVolumeTestJSON-server-906006999</nova:name>
Nov 15 06:05:56 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:05:55</nova:creationTime>
Nov 15 06:05:56 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:05:56 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:05:56 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:05:56 user nova-compute[75648]:       <nova:owner>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:user uuid="5fdcc2d55067412ba64925df1b9ef0e5">tempest-AttachVolumeTestJSON-1331007260-project-member</nova:user>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:project uuid="eb230cb5a30941d5b1901713c9082bfa">tempest-AttachVolumeTestJSON-1331007260</nova:project>
Nov 15 06:05:56 user nova-compute[75648]:       </nova:owner>
Nov 15 06:05:56 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 06:05:56 user nova-compute[75648]:       <nova:ports>
Nov 15 06:05:56 user nova-compute[75648]:         <nova:port uuid="9ddff292-9582-4690-a572-45c807efa5d1">
Nov 15 06:05:56 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 15 06:05:56 user nova-compute[75648]:         </nova:port>
Nov 15 06:05:56 user nova-compute[75648]:       </nova:ports>
Nov 15 06:05:56 user nova-compute[75648]:     </nova:instance>
Nov 15 06:05:56 user nova-compute[75648]:   </metadata>
Nov 15 06:05:56 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:05:56 user nova-compute[75648]:     <system>
Nov 15 06:05:56 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:05:56 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:05:56 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:05:56 user nova-compute[75648]:       <entry name="serial">eafad801-651a-4e91-a5dd-a925b9b7956e</entry>
Nov 15 06:05:56 user nova-compute[75648]:       <entry name="uuid">eafad801-651a-4e91-a5dd-a925b9b7956e</entry>
Nov 15 06:05:56 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:05:56 user nova-compute[75648]:     </system>
Nov 15 06:05:56 user nova-compute[75648]:   </sysinfo>
Nov 15 06:05:56 user nova-compute[75648]:   <os>
Nov 15 06:05:56 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:05:56 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:05:56 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:05:56 user nova-compute[75648]:   </os>
Nov 15 06:05:56 user nova-compute[75648]:   <features>
Nov 15 06:05:56 user nova-compute[75648]:     <acpi/>
Nov 15 06:05:56 user nova-compute[75648]:     <apic/>
Nov 15 06:05:56 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:05:56 user nova-compute[75648]:   </features>
Nov 15 06:05:56 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:05:56 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:05:56 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:05:56 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:05:56 user nova-compute[75648]:   </clock>
Nov 15 06:05:56 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:05:56 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:05:56 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:05:56 user nova-compute[75648]:   </cpu>
Nov 15 06:05:56 user nova-compute[75648]:   <devices>
Nov 15 06:05:56 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 06:05:56 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 06:05:56 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk"/>
Nov 15 06:05:56 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:05:56 user nova-compute[75648]:     </disk>
Nov 15 06:05:56 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:05:56 user nova-compute[75648]:       <mac address="fa:16:3e:62:fa:52"/>
Nov 15 06:05:56 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:05:56 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:05:56 user nova-compute[75648]:       <target dev="tap9ddff292-95"/>
Nov 15 06:05:56 user nova-compute[75648]:     </interface>
Nov 15 06:05:56 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:05:56 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/console.log" append="off"/>
Nov 15 06:05:56 user nova-compute[75648]:     </serial>
Nov 15 06:05:56 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:05:56 user nova-compute[75648]:     <video>
Nov 15 06:05:56 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:05:56 user nova-compute[75648]:     </video>
Nov 15 06:05:56 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:05:56 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:05:56 user nova-compute[75648]:     </rng>
Nov 15 06:05:56 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:05:56 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:05:56 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:05:56 user nova-compute[75648]:     </memballoon>
Nov 15 06:05:56 user nova-compute[75648]:   </devices>
Nov 15 06:05:56 user nova-compute[75648]: </domain>
Nov 15 06:05:56 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-906006999',display_name='tempest-AttachVolumeTestJSON-server-906006999',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-906006999',id=50,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkb0Il8UgQKA30sqFCWgjs7aqlVXLUz22sYvVIa2l5sPwz1QBH5HjMQNoRb5feKtUAWcYZk5+/1vvAJvhinFhGoWcp9PFCRivFfNsSQ37bS5ibFq6yKnCFNgyGXtu/Ehw==',key_name='tempest-keypair-1765136208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-ia946nzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:05:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=eafad801-651a-4e91-a5dd-a925b9b7956e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG os_vif [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc1922db-6e8f-5f25-8bd7-305e3159dd1c', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9ddff292-95, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9ddff292-95, col_values=(('qos', UUID('50a1bb43-0739-4ea4-a7df-ee277d49bc96')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9ddff292-95, col_values=(('external_ids', {'iface-id': '9ddff292-9582-4690-a572-45c807efa5d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:fa:52', 'vm-uuid': 'eafad801-651a-4e91-a5dd-a925b9b7956e'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:56 user nova-compute[75648]: INFO os_vif [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95')
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No VIF found with MAC fa:16:3e:62:fa:52, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updated VIF entry in instance network info cache for port 9ddff292-9582-4690-a572-45c807efa5d1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG nova.network.neutron [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:05:56 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5bd82762-da5a-426d-bf7b-7bb56b1ee7bf req-bde0537a-1854-4425-8e0b-3bf846a426dd service nova] Releasing lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-b5ba6917-1bd9-4eea-b2b5-ae79cdaf5ce3 req-4b9a9d02-79b6-47f7-a1b9-0f11ce36b3c8 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b5ba6917-1bd9-4eea-b2b5-ae79cdaf5ce3 req-4b9a9d02-79b6-47f7-a1b9-0f11ce36b3c8 service nova] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b5ba6917-1bd9-4eea-b2b5-ae79cdaf5ce3 req-4b9a9d02-79b6-47f7-a1b9-0f11ce36b3c8 service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b5ba6917-1bd9-4eea-b2b5-ae79cdaf5ce3 req-4b9a9d02-79b6-47f7-a1b9-0f11ce36b3c8 service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG nova.compute.manager [req-b5ba6917-1bd9-4eea-b2b5-ae79cdaf5ce3 req-4b9a9d02-79b6-47f7-a1b9-0f11ce36b3c8 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] No waiting events found dispatching network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:05:57 user nova-compute[75648]: WARNING nova.compute.manager [req-b5ba6917-1bd9-4eea-b2b5-ae79cdaf5ce3 req-4b9a9d02-79b6-47f7-a1b9-0f11ce36b3c8 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received unexpected event network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 for instance with vm_state building and task_state spawning.
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:57 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 06:05:59 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Instance spawned successfully.
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-e87f458a-a4a8-4218-9c5c-b8f48172f322 req-cdd89a33-f723-4a49-9fd6-dec7b4ae34cb service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e87f458a-a4a8-4218-9c5c-b8f48172f322 req-cdd89a33-f723-4a49-9fd6-dec7b4ae34cb service nova] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e87f458a-a4a8-4218-9c5c-b8f48172f322 req-cdd89a33-f723-4a49-9fd6-dec7b4ae34cb service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-e87f458a-a4a8-4218-9c5c-b8f48172f322 req-cdd89a33-f723-4a49-9fd6-dec7b4ae34cb service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.compute.manager [req-e87f458a-a4a8-4218-9c5c-b8f48172f322 req-cdd89a33-f723-4a49-9fd6-dec7b4ae34cb service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] No waiting events found dispatching network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:05:59 user nova-compute[75648]: WARNING nova.compute.manager [req-e87f458a-a4a8-4218-9c5c-b8f48172f322 req-cdd89a33-f723-4a49-9fd6-dec7b4ae34cb service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received unexpected event network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 for instance with vm_state building and task_state spawning.
Nov 15 06:05:59 user nova-compute[75648]: INFO nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 15 06:05:59 user nova-compute[75648]: DEBUG nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:05:59 user nova-compute[75648]: INFO nova.compute.manager [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Took 5.69 seconds to build instance.
Nov 15 06:05:59 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-956bbf88-9159-433c-a011-137c8826476d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.786s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:07 user nova-compute[75648]: INFO nova.compute.manager [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Terminating instance
Nov 15 06:06:07 user nova-compute[75648]: DEBUG nova.compute.manager [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:07 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-da931236-0714-4ebe-8ad4-b806d9e5ebfb req-d74acf87-d129-4cb3-8dba-d84b248c6611 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-vif-unplugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-da931236-0714-4ebe-8ad4-b806d9e5ebfb req-d74acf87-d129-4cb3-8dba-d84b248c6611 service nova] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-da931236-0714-4ebe-8ad4-b806d9e5ebfb req-d74acf87-d129-4cb3-8dba-d84b248c6611 service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-da931236-0714-4ebe-8ad4-b806d9e5ebfb req-d74acf87-d129-4cb3-8dba-d84b248c6611 service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-da931236-0714-4ebe-8ad4-b806d9e5ebfb req-d74acf87-d129-4cb3-8dba-d84b248c6611 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] No waiting events found dispatching network-vif-unplugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.compute.manager [req-da931236-0714-4ebe-8ad4-b806d9e5ebfb req-d74acf87-d129-4cb3-8dba-d84b248c6611 service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-vif-unplugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Instance destroyed successfully.
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.objects.instance [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lazy-loading 'resources' on Instance uuid c34a321d-5e9e-48d4-b64c-052897369754 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:03:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-861283748',display_name='tempest-AttachVolumeNegativeTest-server-861283748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-861283748',id=49,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLestBxtGmYVsALSSF3fvZctRhNKPsy4wynq04UZU6yUIoN9krnup7pD/v9bOg7+CHtx1gXvaetw7yR/PmJlDR92XTJDDFVIVKyixvc+2sreBYt6fK0tKNW9XlHGCW5CiA==',key_name='tempest-keypair-1568807904',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:03:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06304608934649daab8dc8e603b9a446',ramdisk_id='',reservation_id='r-3sn5jlgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-2114996187',owner_user_name='tempest-AttachVolumeNegativeTest-2114996187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:03:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f995cb1428a414d91dd043e1c53d130',uuid=c34a321d-5e9e-48d4-b64c-052897369754,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converting VIF {"id": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "address": "fa:16:3e:45:67:fd", "network": {"id": "8d513900-6793-40b4-9091-41067efd4ed5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-913967677-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.237", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06304608934649daab8dc8e603b9a446", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e5eae51-f4", "ovs_interfaceid": "1e5eae51-f4ea-4a81-bed2-e370afedd1b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG os_vif [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e5eae51-f4, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=09cfaf67-13d9-4b1c-9767-a49fe8bd8ebb) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:06:08 user nova-compute[75648]: INFO os_vif [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:67:fd,bridge_name='br-int',has_traffic_filtering=True,id=1e5eae51-f4ea-4a81-bed2-e370afedd1b1,network=Network(8d513900-6793-40b4-9091-41067efd4ed5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e5eae51-f4')
Nov 15 06:06:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Deleting instance files /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754_del
Nov 15 06:06:08 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Deletion of /opt/stack/data/nova/instances/c34a321d-5e9e-48d4-b64c-052897369754_del complete
Nov 15 06:06:08 user nova-compute[75648]: INFO nova.compute.manager [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 06:06:08 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:06:08 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c34a321d-5e9e-48d4-b64c-052897369754] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:06:09 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:06:09 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Took 0.66 seconds to deallocate network for instance.
Nov 15 06:06:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:09 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:06:09 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:06:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.174s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:09 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Deleted allocations for instance c34a321d-5e9e-48d4-b64c-052897369754
Nov 15 06:06:09 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-e6600945-19eb-4dce-a670-dc864ec8c10d tempest-AttachVolumeNegativeTest-2114996187 tempest-AttachVolumeNegativeTest-2114996187-project-member] Lock "c34a321d-5e9e-48d4-b64c-052897369754" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.857s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] Acquiring lock "c34a321d-5e9e-48d4-b64c-052897369754-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] Lock "c34a321d-5e9e-48d4-b64c-052897369754-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] No waiting events found dispatching network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:06:10 user nova-compute[75648]: WARNING nova.compute.manager [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received unexpected event network-vif-plugged-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 for instance with vm_state deleted and task_state None.
Nov 15 06:06:10 user nova-compute[75648]: DEBUG nova.compute.manager [req-5443ae23-1f06-4417-9533-bdf873b1f105 req-894630af-9af8-48a5-9572-4bad71ff593f service nova] [instance: c34a321d-5e9e-48d4-b64c-052897369754] Received event network-vif-deleted-1e5eae51-f4ea-4a81-bed2-e370afedd1b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.003s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:06:10 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:11 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:06:11 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8653MB free_disk=25.216022491455078GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance eafad801-651a-4e91-a5dd-a925b9b7956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:06:11 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:06:12 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid b955533a-d29e-4a8f-9c8e-7da7ae052eae {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:06:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [{"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:06:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-b955533a-d29e-4a8f-9c8e-7da7ae052eae" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:06:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:06:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:15 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:06:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:06:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:06:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:06:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:06:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:06:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:40 user nova-compute[75648]: INFO nova.compute.manager [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Terminating instance
Nov 15 06:06:40 user nova-compute[75648]: DEBUG nova.compute.manager [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-3b80f0e7-a1ce-4f48-85ce-24bf986468d6 req-2e12a9bb-aead-43a0-8a0e-94130bbc517e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-unplugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3b80f0e7-a1ce-4f48-85ce-24bf986468d6 req-2e12a9bb-aead-43a0-8a0e-94130bbc517e service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3b80f0e7-a1ce-4f48-85ce-24bf986468d6 req-2e12a9bb-aead-43a0-8a0e-94130bbc517e service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3b80f0e7-a1ce-4f48-85ce-24bf986468d6 req-2e12a9bb-aead-43a0-8a0e-94130bbc517e service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-3b80f0e7-a1ce-4f48-85ce-24bf986468d6 req-2e12a9bb-aead-43a0-8a0e-94130bbc517e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-unplugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-3b80f0e7-a1ce-4f48-85ce-24bf986468d6 req-2e12a9bb-aead-43a0-8a0e-94130bbc517e service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-unplugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:40 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Instance destroyed successfully.
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.objects.instance [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'resources' on Instance uuid 23e250a1-2c65-4ba1-b8d8-09cf4334ad44 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-586828384',display_name='tempest-ServerActionsTestOtherA-server-586828384',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-586828384',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:02:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-7g6p2edv',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:03:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=23e250a1-2c65-4ba1-b8d8-09cf4334ad44,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "address": "fa:16:3e:09:73:2d", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a05de2b-06", "ovs_interfaceid": "0a05de2b-0610-4a54-9a2b-7b80f5c5d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_vif [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a05de2b-06, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e5080927-10f0-4f05-8419-b1be1d70caed) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:06:41 user nova-compute[75648]: INFO os_vif [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:73:2d,bridge_name='br-int',has_traffic_filtering=True,id=0a05de2b-0610-4a54-9a2b-7b80f5c5d399,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a05de2b-06')
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JHMyPpVI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:06:41 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c677ff-59e9-4b32-a5ef-6c3416ce9708]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:06:41 user nova-compute[75648]: No targets found.
Nov 15 06:06:41 user nova-compute[75648]: iSNS:
Nov 15 06:06:41 user nova-compute[75648]: No targets found.
Nov 15 06:06:41 user nova-compute[75648]: STATIC:
Nov 15 06:06:41 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79
Nov 15 06:06:41 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:06:41 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:06:41 user nova-compute[75648]: FIRMWARE:
Nov 15 06:06:41 user nova-compute[75648]: No targets found.
Nov 15 06:06:41 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:06:41 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:06:41 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ee6ec6-4542-428f-b9a0-f68b9fc68c53]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1998d5f-de8e-483b-8ea7-a9f7c296c362]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:06:41 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 (non-flash)
Nov 15 06:06:41 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e84f08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22889fa-2966-4517-8617-9bbd142b4144]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0b8ca-17aa-4243-a1fa-20b9473a86ad]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[946c3ce8-6d4e-42de-976e-c3a34d93ed8c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822f03b-8af2-43fd-95cc-7e1cfabcd44d]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO50b2c0ea-2095388e60fdeb72', '/dev/disk/by-id/scsi-23230393533383865', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_50b2c0ea') {{(pid=87015) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefa23dc-6b96-4b7f-804c-bd23b809e3e0]: (4, None) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f8bef9-d3e8-4356-9249-fb008b687b4b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d0f353-b482-43e6-96af-6bfebc423423]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260]
Nov 15 06:06:41 user nova-compute[75648]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79, portal: 172.16.0.220,3260] successful.
Nov 15 06:06:41 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b99c4e57-182b-402d-8892-faf894405f79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[783c2bf7-81c9-4ba7-ac74-9ffa07e01df3]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] <== disconnect_volume: return (306ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:06:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Deleting instance files /opt/stack/data/nova/instances/23e250a1-2c65-4ba1-b8d8-09cf4334ad44_del
Nov 15 06:06:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Deletion of /opt/stack/data/nova/instances/23e250a1-2c65-4ba1-b8d8-09cf4334ad44_del complete
Nov 15 06:06:41 user nova-compute[75648]: INFO nova.compute.manager [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 15 06:06:41 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:06:41 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:06:42 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:06:42 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Took 0.89 seconds to deallocate network for instance.
Nov 15 06:06:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-f8835ec7-915d-496c-b8ba-8ee68b157c12 req-124f7514-4688-4a44-b8c3-161fe7d24363 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-deleted-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:06:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-d813f868-7f48-45ab-a896-c339232ebaaa req-0c3399e1-b9a9-4e7a-9a91-20dfc2e7d3a5 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:06:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d813f868-7f48-45ab-a896-c339232ebaaa req-0c3399e1-b9a9-4e7a-9a91-20dfc2e7d3a5 service nova] Acquiring lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d813f868-7f48-45ab-a896-c339232ebaaa req-0c3399e1-b9a9-4e7a-9a91-20dfc2e7d3a5 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-d813f868-7f48-45ab-a896-c339232ebaaa req-0c3399e1-b9a9-4e7a-9a91-20dfc2e7d3a5 service nova] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-d813f868-7f48-45ab-a896-c339232ebaaa req-0c3399e1-b9a9-4e7a-9a91-20dfc2e7d3a5 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] No waiting events found dispatching network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:06:42 user nova-compute[75648]: WARNING nova.compute.manager [req-d813f868-7f48-45ab-a896-c339232ebaaa req-0c3399e1-b9a9-4e7a-9a91-20dfc2e7d3a5 service nova] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Received unexpected event network-vif-plugged-0a05de2b-0610-4a54-9a2b-7b80f5c5d399 for instance with vm_state active and task_state deleting.
Nov 15 06:06:43 user nova-compute[75648]: INFO nova.compute.manager [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Took 0.72 seconds to detach 1 volumes for instance.
Nov 15 06:06:43 user nova-compute[75648]: DEBUG nova.compute.manager [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: 23e250a1-2c65-4ba1-b8d8-09cf4334ad44] Deleting volume: b99c4e57-182b-402d-8892-faf894405f79 {{(pid=75648) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 15 06:06:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:06:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:06:43 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:06:43 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:06:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:43 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Deleted allocations for instance 23e250a1-2c65-4ba1-b8d8-09cf4334ad44
Nov 15 06:06:43 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-12c3e8c2-0e5a-4812-a55b-e2bcc374c39d tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "23e250a1-2c65-4ba1-b8d8-09cf4334ad44" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.182s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:06:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:06:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:09 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:12 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:13 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:07:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8878MB free_disk=25.186630249023438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance b955533a-d29e-4a8f-9c8e-7da7ae052eae actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance eafad801-651a-4e91-a5dd-a925b9b7956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:07:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.209s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:07:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:31 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:33 user nova-compute[75648]: INFO nova.compute.manager [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Terminating instance
Nov 15 06:07:33 user nova-compute[75648]: DEBUG nova.compute.manager [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-460bc83f-82cc-4cd8-8e7e-fda1eb2dc78b req-e4ee113e-cd8d-487b-ac2f-7637bb44bf81 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-unplugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-460bc83f-82cc-4cd8-8e7e-fda1eb2dc78b req-e4ee113e-cd8d-487b-ac2f-7637bb44bf81 service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-460bc83f-82cc-4cd8-8e7e-fda1eb2dc78b req-e4ee113e-cd8d-487b-ac2f-7637bb44bf81 service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-460bc83f-82cc-4cd8-8e7e-fda1eb2dc78b req-e4ee113e-cd8d-487b-ac2f-7637bb44bf81 service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-460bc83f-82cc-4cd8-8e7e-fda1eb2dc78b req-e4ee113e-cd8d-487b-ac2f-7637bb44bf81 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-unplugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG nova.compute.manager [req-460bc83f-82cc-4cd8-8e7e-fda1eb2dc78b req-e4ee113e-cd8d-487b-ac2f-7637bb44bf81 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-unplugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Instance destroyed successfully.
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lazy-loading 'resources' on Instance uuid b955533a-d29e-4a8f-9c8e-7da7ae052eae {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T05:48:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-536338520',display_name='tempest-ServerActionsTestOtherA-server-536338520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-536338520',id=32,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEpuuAmuvBMYgt+yW4USJVQy6iHB+49x3h8cd6kAOhsfjqWtCuqDy3BZNQSOcpJ8x069hwCvAPwewIkprz6WmSLfxs7wafajhFF/l/1w2E19krgaPmfgzZejSFqHmyQF6Q==',key_name='tempest-keypair-481707992',keypairs=<?>,launch_index=0,launched_at=2023-11-15T05:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06bd3ce1caf14075b2d936ac45b143f5',ramdisk_id='',reservation_id='r-i11f5trz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-442850377',owner_user_name='tempest-ServerActionsTestOtherA-442850377-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T05:48:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5d61be40c2864afc99cd689efdb30308',uuid=b955533a-d29e-4a8f-9c8e-7da7ae052eae,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converting VIF {"id": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "address": "fa:16:3e:b0:5b:fd", "network": {"id": "bcb4a729-ac2e-4199-a933-2c318638efc9", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-513549052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06bd3ce1caf14075b2d936ac45b143f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f136ac9-7a", "ovs_interfaceid": "7f136ac9-7a79-436e-a0a9-9bee09fcf9b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG os_vif [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f136ac9-7a, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1272cee-648c-477f-b6cd-300fe561a971) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:34 user nova-compute[75648]: INFO os_vif [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:5b:fd,bridge_name='br-int',has_traffic_filtering=True,id=7f136ac9-7a79-436e-a0a9-9bee09fcf9b1,network=Network(bcb4a729-ac2e-4199-a933-2c318638efc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f136ac9-7a')
Nov 15 06:07:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Deleting instance files /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae_del
Nov 15 06:07:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Deletion of /opt/stack/data/nova/instances/b955533a-d29e-4a8f-9c8e-7da7ae052eae_del complete
Nov 15 06:07:34 user nova-compute[75648]: INFO nova.compute.manager [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 15 06:07:34 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:07:34 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Took 0.50 seconds to deallocate network for instance.
Nov 15 06:07:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-b50b8f76-ebdd-4e8c-8027-0c1f100f31ef req-b12dac26-1a04-4eb8-9046-2ee4a8fd2d60 service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-deleted-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:07:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:34 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Deleted allocations for instance b955533a-d29e-4a8f-9c8e-7da7ae052eae
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-9f95eac1-5faa-4e64-abc4-09fd67ef5dad tempest-ServerActionsTestOtherA-442850377 tempest-ServerActionsTestOtherA-442850377-project-member] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:07:35 user nova-compute[75648]: WARNING nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state deleted and task_state None.
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:07:35 user nova-compute[75648]: WARNING nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state deleted and task_state None.
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:07:35 user nova-compute[75648]: WARNING nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state deleted and task_state None.
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-unplugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-unplugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:07:35 user nova-compute[75648]: WARNING nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-unplugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state deleted and task_state None.
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Acquiring lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] Lock "b955533a-d29e-4a8f-9c8e-7da7ae052eae-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] No waiting events found dispatching network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:07:35 user nova-compute[75648]: WARNING nova.compute.manager [req-64f11fc1-c270-45c2-8b56-6d9a2025f759 req-e2be401a-8a19-471d-aa1c-c6aff08e6e4e service nova] [instance: b955533a-d29e-4a8f-9c8e-7da7ae052eae] Received unexpected event network-vif-plugged-7f136ac9-7a79-436e-a0a9-9bee09fcf9b1 for instance with vm_state deleted and task_state None.
Nov 15 06:07:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-changed-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Refreshing instance network info cache due to event network-changed-9ddff292-9582-4690-a572-45c807efa5d1. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] Acquiring lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] Acquired lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:07:44 user nova-compute[75648]: DEBUG nova.network.neutron [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Refreshing network info cache for port 9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:07:45 user nova-compute[75648]: DEBUG nova.network.neutron [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updated VIF entry in instance network info cache for port 9ddff292-9582-4690-a572-45c807efa5d1. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:07:45 user nova-compute[75648]: DEBUG nova.network.neutron [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:07:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-7f8bfae0-07c2-4928-90c0-1b37dc3fd92a req-59af34e7-0f13-4817-b9d2-1933e2eac51b service nova] Releasing lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG nova.objects.instance [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:46 user nova-compute[75648]: INFO nova.compute.manager [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attaching volume 1f928168-2cf2-45f8-b2ef-45cc7e673515 to /dev/vdb
Nov 15 06:07:46 user nova-compute[75648]: DEBUG os_brick.utils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[23307faf-a6dd-448b-aa0c-11953884111b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb55cc-9226-4a14-a4a7-ed714bb4fc2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5540aefc-3513-4eaa-9289-ede7bb842b52]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f35a335-ff92-478c-9990-e0020bcdc576]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:07:46 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:07:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6cb935-b21d-4fae-9281-059e8f67b7b0]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG os_brick.utils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:07:46 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating existing volume attachment record: 2fc99324-66b3-435e-9472-f59c729a938c {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:07:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQvZuzDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:07:51 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:07:51 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:07:51 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[618e53e2-0780-459a-87d2-13db1c1491e9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:07:51 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe25a0a-5910-42d6-a34a-a24928f3d6a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515] added
Nov 15 06:07:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e44ec4f-c238-4616-acca-18d130002819]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6e7ef7-bb6e-4053-acd7-eba62866189c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQvZuzDo {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dQvZuzDo" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[89985f03-5bbb-45f0-af5b-4a1d18a10c01]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dQvZuzDo'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b14ff3a-1b2c-4f08-8b3b-25d03d56e860]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9c37c5-320e-4e9d-9e04-9a1d74c27436]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 06:07:51 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 06:07:51 user nova-compute[75648]:  {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:07:51 user nova-compute[75648]: WARNING os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 06:07:51 user nova-compute[75648]: 
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e9ad3-3aa3-4a6f-a9c8-67c6149508c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260]
Nov 15 06:07:51 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260] successful.
Nov 15 06:07:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2a9e44-572a-414c-9a21-5a46956d75e0]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4ba94a-3854-4fa9-83d1-39502db9800c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:07:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:07:51 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.239s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca730156-8645-4092-a50b-3e0d856f931d]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:51 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQvZuzDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26261383239393733', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261383239393733', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG nova.objects.instance [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:07:52 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:07:52 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 06:07:52 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:07:52 user nova-compute[75648]:   <serial>1f928168-2cf2-45f8-b2ef-45cc7e673515</serial>
Nov 15 06:07:52 user nova-compute[75648]: </disk>
Nov 15 06:07:52 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:07:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No VIF found with MAC fa:16:3e:62:fa:52, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:07:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-69416206-7f66-419e-8181-2ba867c16592 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.402s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:07:54 user nova-compute[75648]: INFO nova.compute.manager [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attaching volume 6e468b78-12b3-41f6-b857-bd57d69aa42c to /dev/vdc
Nov 15 06:07:54 user nova-compute[75648]: DEBUG os_brick.utils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:54 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf820266-1834-495c-8bc5-688ef7e15288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[66852b78-2440-4141-9776-c95f909f6205]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a9ae43-4703-4d92-8423-131b758095e5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[45744085-6ca3-4322-b3a8-e969c6b7d7d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:07:55 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:07:55 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281e1d0-2f8f-494b-9533-53deac4ff5de]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG os_brick.utils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:07:55 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating existing volume attachment record: 189145fe-a2f7-46d8-b8b2-db29b5b0f918 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:07:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poaGxWPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:07:59 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:07:59 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:07:59 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdabc414-6965-4004-b156-2a9526123d17]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:07:59 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[571df47a-2e46-4af0-b8e1-e6cb40a5ddb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c] added
Nov 15 06:07:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37e8c17-a813-4bc2-8398-2e6146017255]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b830d5ae-ebe1-4127-86f0-e444d44d27b7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v poaGxWPF {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v poaGxWPF" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dbb1f5-c361-4d47-9b97-01756f9403c1]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'poaGxWPF'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07eef2e-65cf-41e3-9cbf-624058eb69f7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa800c41-fb6e-49a3-8322-e6c10e87784e]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:07:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:07:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae883e1f-8170-40ba-966e-9bfc5c8e964d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260]
Nov 15 06:07:59 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260] successful.
Nov 15 06:07:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a00855-322b-412e-8d53-8eb3ec3b3d0a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9b2e7-67b7-442d-9046-1401f3c3eda4]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:07:59 user nova-compute[75648]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)
Nov 15 06:07:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:07:59 user nova-compute[75648]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)
Nov 15 06:07:59 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[670eccaa-ce4c-4cc8-a5c1-74c2a4b45c30]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:07:59 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poaGxWPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:08:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:08:00 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23363363363353330', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:08:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363363363353330', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:08:00 user nova-compute[75648]: DEBUG nova.objects.instance [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:08:00 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:08:00 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:08:00 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:08:00 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 06:08:00 user nova-compute[75648]:   <serial>6e468b78-12b3-41f6-b857-bd57d69aa42c</serial>
Nov 15 06:08:00 user nova-compute[75648]: </disk>
Nov 15 06:08:00 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:08:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:08:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:08:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:08:01 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] No VIF found with MAC fa:16:3e:62:fa:52, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:08:01 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-1d1f1719-c3ab-4641-84ce-49546f6849eb tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.402s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:02 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:02 user nova-compute[75648]: INFO nova.compute.manager [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Detaching volume 1f928168-2cf2-45f8-b2ef-45cc7e673515
Nov 15 06:08:02 user nova-compute[75648]: INFO nova.virt.block_device [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attempting to driver detach volume 1f928168-2cf2-45f8-b2ef-45cc7e673515 from mountpoint /dev/vdb
Nov 15 06:08:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Attempting to detach device vdb from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:08:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:08:02 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:08:02 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 06:08:02 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:08:02 user nova-compute[75648]:   <serial>1f928168-2cf2-45f8-b2ef-45cc7e673515</serial>
Nov 15 06:08:02 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:08:02 user nova-compute[75648]: </disk>
Nov 15 06:08:02 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:08:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully detached device vdb from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the persistent domain config.
Nov 15 06:08:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:08:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:08:02 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:08:02 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 06:08:02 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:08:02 user nova-compute[75648]:   <serial>1f928168-2cf2-45f8-b2ef-45cc7e673515</serial>
Nov 15 06:08:02 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:08:02 user nova-compute[75648]: </disk>
Nov 15 06:08:02 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:08:03 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:08:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:08:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [{"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-eafad801-651a-4e91-a5dd-a925b9b7956e" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:08:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:14 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:08:15 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:08:15 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8970MB free_disk=25.202667236328125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance eafad801-651a-4e91-a5dd-a925b9b7956e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:08:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:08:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:08:23 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eafad801-651a-4e91-a5dd-a925b9b7956e is timed out.
Nov 15 06:08:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully detached device vdb from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the live domain config.
Nov 15 06:08:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dQvZuzDo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:08:23 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[da268ebb-11d2-43b1-8504-fe25af9de40c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:08:23 user nova-compute[75648]: No targets found.
Nov 15 06:08:23 user nova-compute[75648]: iSNS:
Nov 15 06:08:23 user nova-compute[75648]: No targets found.
Nov 15 06:08:23 user nova-compute[75648]: STATIC:
Nov 15 06:08:23 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515
Nov 15 06:08:23 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:08:23 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:08:23 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c
Nov 15 06:08:23 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:08:23 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:08:23 user nova-compute[75648]: FIRMWARE:
Nov 15 06:08:23 user nova-compute[75648]: No targets found.
Nov 15 06:08:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:08:23 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:08:23 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc4efa4-06cd-4be7-8b44-cc445997fe8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f324ed-81cd-4598-8902-058508e758a2]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:08:23 user nova-compute[75648]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)
Nov 15 06:08:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 (non-flash)
Nov 15 06:08:23 user nova-compute[75648]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)
Nov 15 06:08:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9e8654820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47b4ea7-28ca-4063-bc4c-5ade871754f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88411bf-41fd-455b-b5ca-189e25d774de]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef219be-5d17-4606-8cd4-98c191872c2c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[179b1a84-f171-40f4-b829-3bafa4e6adcc]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1f221c-ca04-43ca-8d1a-49cfc2518403]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d82c63e-ed44-49c5-88d8-710118fb6fba]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260]
Nov 15 06:08:23 user nova-compute[75648]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515, portal: 172.16.0.220,3260] successful.
Nov 15 06:08:23 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f928168-2cf2-45f8-b2ef-45cc7e673515 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc95e05-b64c-43f1-b147-e3bcf1e67322]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== disconnect_volume: return (306ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:08:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:08:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:24 user nova-compute[75648]: DEBUG nova.objects.instance [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:08:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-6d1d20a5-e2ae-4290-bbcc-8166419b7853 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:25 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:25 user nova-compute[75648]: INFO nova.compute.manager [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Detaching volume 6e468b78-12b3-41f6-b857-bd57d69aa42c
Nov 15 06:08:25 user nova-compute[75648]: INFO nova.virt.block_device [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Attempting to driver detach volume 6e468b78-12b3-41f6-b857-bd57d69aa42c from mountpoint /dev/vdc
Nov 15 06:08:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Attempting to detach device vdc from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:08:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:08:25 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:08:25 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:08:25 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 06:08:25 user nova-compute[75648]:   <serial>6e468b78-12b3-41f6-b857-bd57d69aa42c</serial>
Nov 15 06:08:25 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 06:08:25 user nova-compute[75648]: </disk>
Nov 15 06:08:25 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:08:25 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully detached device vdc from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the persistent domain config.
Nov 15 06:08:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:08:25 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:08:25 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:08:25 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:08:25 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 06:08:25 user nova-compute[75648]:   <serial>6e468b78-12b3-41f6-b857-bd57d69aa42c</serial>
Nov 15 06:08:25 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 06:08:25 user nova-compute[75648]: </disk>
Nov 15 06:08:25 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:08:26 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:08:27 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:08:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:08:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:46 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance eafad801-651a-4e91-a5dd-a925b9b7956e is timed out.
Nov 15 06:08:46 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully detached device vdc from instance eafad801-651a-4e91-a5dd-a925b9b7956e from the live domain config.
Nov 15 06:08:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'poaGxWPF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:08:46 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d3bc2-43e6-42c4-b61a-5e56d1381209]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:08:46 user nova-compute[75648]: No targets found.
Nov 15 06:08:46 user nova-compute[75648]: iSNS:
Nov 15 06:08:46 user nova-compute[75648]: No targets found.
Nov 15 06:08:46 user nova-compute[75648]: STATIC:
Nov 15 06:08:46 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c
Nov 15 06:08:46 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:08:46 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:08:46 user nova-compute[75648]: FIRMWARE:
Nov 15 06:08:46 user nova-compute[75648]: No targets found.
Nov 15 06:08:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:08:46 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:08:46 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c7bd52-ff33-42f7-8cc1-837ec29ca920]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e25bb6-171d-4838-a6e6-adb22658be6b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)
Nov 15 06:08:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c (non-flash)
Nov 15 06:08:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47ccca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[35412bf5-d306-451f-ae86-b8eeef56534f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9fb788-017c-4d97-9431-13dbd0d1b87e]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a0e13-6600-4122-a0c7-a85af2931b2c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[525a1f6e-419a-465c-8c54-88ac64124168]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[82f996fd-c9e0-48ea-86e7-a80714798f22]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff7a3b3-b3a5-4e73-ab35-40743eff841e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260]
Nov 15 06:08:46 user nova-compute[75648]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c, portal: 172.16.0.220,3260] successful.
Nov 15 06:08:46 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e468b78-12b3-41f6-b857-bd57d69aa42c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c0550-453e-4398-942e-08cae8a15c7a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] <== disconnect_volume: return (278ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:08:46 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:08:47 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'flavor' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:08:47 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b1814625-0b22-4371-af72-e345f790d923 tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.810s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:48 user nova-compute[75648]: INFO nova.compute.manager [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Terminating instance
Nov 15 06:08:48 user nova-compute[75648]: DEBUG nova.compute.manager [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-3ccbe18f-30f4-4312-a96f-3dd81d09e05e req-c170e195-1c6a-416f-a25a-fd4310375bd0 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-vif-unplugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3ccbe18f-30f4-4312-a96f-3dd81d09e05e req-c170e195-1c6a-416f-a25a-fd4310375bd0 service nova] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3ccbe18f-30f4-4312-a96f-3dd81d09e05e req-c170e195-1c6a-416f-a25a-fd4310375bd0 service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3ccbe18f-30f4-4312-a96f-3dd81d09e05e req-c170e195-1c6a-416f-a25a-fd4310375bd0 service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-3ccbe18f-30f4-4312-a96f-3dd81d09e05e req-c170e195-1c6a-416f-a25a-fd4310375bd0 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] No waiting events found dispatching network-vif-unplugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:08:48 user nova-compute[75648]: DEBUG nova.compute.manager [req-3ccbe18f-30f4-4312-a96f-3dd81d09e05e req-c170e195-1c6a-416f-a25a-fd4310375bd0 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-vif-unplugged-9ddff292-9582-4690-a572-45c807efa5d1 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:08:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Instance destroyed successfully.
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.objects.instance [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lazy-loading 'resources' on Instance uuid eafad801-651a-4e91-a5dd-a925b9b7956e {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:05:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-906006999',display_name='tempest-AttachVolumeTestJSON-server-906006999',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-906006999',id=50,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkb0Il8UgQKA30sqFCWgjs7aqlVXLUz22sYvVIa2l5sPwz1QBH5HjMQNoRb5feKtUAWcYZk5+/1vvAJvhinFhGoWcp9PFCRivFfNsSQ37bS5ibFq6yKnCFNgyGXtu/Ehw==',key_name='tempest-keypair-1765136208',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:05:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='eb230cb5a30941d5b1901713c9082bfa',ramdisk_id='',reservation_id='r-ia946nzw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1331007260',owner_user_name='tempest-AttachVolumeTestJSON-1331007260-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:06:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5fdcc2d55067412ba64925df1b9ef0e5',uuid=eafad801-651a-4e91-a5dd-a925b9b7956e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converting VIF {"id": "9ddff292-9582-4690-a572-45c807efa5d1", "address": "fa:16:3e:62:fa:52", "network": {"id": "4f217bad-1597-4524-8b75-3ef16eedad19", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1002336390-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "eb230cb5a30941d5b1901713c9082bfa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ddff292-95", "ovs_interfaceid": "9ddff292-9582-4690-a572-45c807efa5d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG os_vif [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ddff292-95, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50a1bb43-0739-4ea4-a7df-ee277d49bc96) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:49 user nova-compute[75648]: INFO os_vif [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:fa:52,bridge_name='br-int',has_traffic_filtering=True,id=9ddff292-9582-4690-a572-45c807efa5d1,network=Network(4f217bad-1597-4524-8b75-3ef16eedad19),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9ddff292-95')
Nov 15 06:08:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Deleting instance files /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e_del
Nov 15 06:08:49 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Deletion of /opt/stack/data/nova/instances/eafad801-651a-4e91-a5dd-a925b9b7956e_del complete
Nov 15 06:08:49 user nova-compute[75648]: INFO nova.compute.manager [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 15 06:08:49 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:08:49 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Took 0.64 seconds to deallocate network for instance.
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-a0ec978e-46b5-42f8-9d11-e648eda0e669 req-c45f542e-5511-40da-a164-4f19a6eb68fc service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-vif-deleted-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:08:49 user nova-compute[75648]: INFO nova.compute.manager [req-a0ec978e-46b5-42f8-9d11-e648eda0e669 req-c45f542e-5511-40da-a164-4f19a6eb68fc service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Neutron deleted interface 9ddff292-9582-4690-a572-45c807efa5d1; detaching it from the instance and deleting it from the info cache
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.network.neutron [req-a0ec978e-46b5-42f8-9d11-e648eda0e669 req-c45f542e-5511-40da-a164-4f19a6eb68fc service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.compute.manager [req-a0ec978e-46b5-42f8-9d11-e648eda0e669 req-c45f542e-5511-40da-a164-4f19a6eb68fc service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Detach interface failed, port_id=9ddff292-9582-4690-a572-45c807efa5d1, reason: Instance eafad801-651a-4e91-a5dd-a925b9b7956e could not be found. {{(pid=75648) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:08:49 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:50 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Deleted allocations for instance eafad801-651a-4e91-a5dd-a925b9b7956e
Nov 15 06:08:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-efdc54f3-557e-48d5-a503-1a12fac39d9d tempest-AttachVolumeTestJSON-1331007260 tempest-AttachVolumeTestJSON-1331007260-project-member] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.922s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-4a2891be-40f7-42ca-8eb2-6fb85b18efa3 req-98cd0a01-fc61-48ef-a3e7-720e04abe723 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received event network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:08:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4a2891be-40f7-42ca-8eb2-6fb85b18efa3 req-98cd0a01-fc61-48ef-a3e7-720e04abe723 service nova] Acquiring lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:08:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4a2891be-40f7-42ca-8eb2-6fb85b18efa3 req-98cd0a01-fc61-48ef-a3e7-720e04abe723 service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:08:50 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-4a2891be-40f7-42ca-8eb2-6fb85b18efa3 req-98cd0a01-fc61-48ef-a3e7-720e04abe723 service nova] Lock "eafad801-651a-4e91-a5dd-a925b9b7956e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:08:50 user nova-compute[75648]: DEBUG nova.compute.manager [req-4a2891be-40f7-42ca-8eb2-6fb85b18efa3 req-98cd0a01-fc61-48ef-a3e7-720e04abe723 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] No waiting events found dispatching network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:08:50 user nova-compute[75648]: WARNING nova.compute.manager [req-4a2891be-40f7-42ca-8eb2-6fb85b18efa3 req-98cd0a01-fc61-48ef-a3e7-720e04abe723 service nova] [instance: eafad801-651a-4e91-a5dd-a925b9b7956e] Received unexpected event network-vif-plugged-9ddff292-9582-4690-a572-45c807efa5d1 for instance with vm_state deleted and task_state None.
Nov 15 06:08:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:08:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:08:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:08:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:08:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:09:02 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:10 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:09:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:09:12 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 06:09:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:09:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:09:14 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=9144MB free_disk=25.226131439208984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:09:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:09:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:30 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:32 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:32 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:09:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:37 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:09:39 user nova-compute[75648]: INFO nova.compute.claims [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Claim successful on node user
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.192s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 06:09:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 06:09:39 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Creating image(s)
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "/opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "/opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "/opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG nova.policy [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cb329bb8fc415f8bda11dc4acad2fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c1c7c2127c1944e19cfdcd051525a3ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.173s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk 1073741824" returned: 0 in 0.056s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.189s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Successfully created port: c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Cannot resize image /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Ensure instance console log exists: /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Successfully updated port: c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquired lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-changed-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.compute.manager [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Refreshing instance network info cache due to event network-changed-c557fae6-fb04-4b3d-be67-2b06fd2957f5. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] Acquiring lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:09:40 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.neutron [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updating instance_info_cache with network_info: [{"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Releasing lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Instance network_info: |[{"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] Acquired lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Refreshing network info cache for port c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Start _get_guest_xml network_info=[{"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:09:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:09:41 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-471477797',display_name='tempest-VolumesActionsTest-instance-471477797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-471477797',id=51,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c7c2127c1944e19cfdcd051525a3ef',ramdisk_id='',reservation_id='r-x0w9xpl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1219950169',owner_user_name='tempest-VolumesActionsTest-1219950169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:09:39Z,user_data=None,user_id='76cb329bb8fc415f8bda11dc4acad2fb',uuid=af22adcb-77ad-4c01-974c-0081c98cfc43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Converting VIF {"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lazy-loading 'pci_devices' on Instance uuid af22adcb-77ad-4c01-974c-0081c98cfc43 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:09:41 user nova-compute[75648]:   <uuid>af22adcb-77ad-4c01-974c-0081c98cfc43</uuid>
Nov 15 06:09:41 user nova-compute[75648]:   <name>instance-00000033</name>
Nov 15 06:09:41 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:09:41 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:09:41 user nova-compute[75648]:   <metadata>
Nov 15 06:09:41 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:09:41 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:09:41 user nova-compute[75648]:       <nova:name>tempest-VolumesActionsTest-instance-471477797</nova:name>
Nov 15 06:09:41 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:09:41</nova:creationTime>
Nov 15 06:09:41 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:09:41 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:09:41 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:09:41 user nova-compute[75648]:       <nova:owner>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:user uuid="76cb329bb8fc415f8bda11dc4acad2fb">tempest-VolumesActionsTest-1219950169-project-member</nova:user>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:project uuid="c1c7c2127c1944e19cfdcd051525a3ef">tempest-VolumesActionsTest-1219950169</nova:project>
Nov 15 06:09:41 user nova-compute[75648]:       </nova:owner>
Nov 15 06:09:41 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 06:09:41 user nova-compute[75648]:       <nova:ports>
Nov 15 06:09:41 user nova-compute[75648]:         <nova:port uuid="c557fae6-fb04-4b3d-be67-2b06fd2957f5">
Nov 15 06:09:41 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 06:09:41 user nova-compute[75648]:         </nova:port>
Nov 15 06:09:41 user nova-compute[75648]:       </nova:ports>
Nov 15 06:09:41 user nova-compute[75648]:     </nova:instance>
Nov 15 06:09:41 user nova-compute[75648]:   </metadata>
Nov 15 06:09:41 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:09:41 user nova-compute[75648]:     <system>
Nov 15 06:09:41 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:09:41 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:09:41 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:09:41 user nova-compute[75648]:       <entry name="serial">af22adcb-77ad-4c01-974c-0081c98cfc43</entry>
Nov 15 06:09:41 user nova-compute[75648]:       <entry name="uuid">af22adcb-77ad-4c01-974c-0081c98cfc43</entry>
Nov 15 06:09:41 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:09:41 user nova-compute[75648]:     </system>
Nov 15 06:09:41 user nova-compute[75648]:   </sysinfo>
Nov 15 06:09:41 user nova-compute[75648]:   <os>
Nov 15 06:09:41 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:09:41 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:09:41 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:09:41 user nova-compute[75648]:   </os>
Nov 15 06:09:41 user nova-compute[75648]:   <features>
Nov 15 06:09:41 user nova-compute[75648]:     <acpi/>
Nov 15 06:09:41 user nova-compute[75648]:     <apic/>
Nov 15 06:09:41 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:09:41 user nova-compute[75648]:   </features>
Nov 15 06:09:41 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:09:41 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:09:41 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:09:41 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:09:41 user nova-compute[75648]:   </clock>
Nov 15 06:09:41 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:09:41 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:09:41 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:09:41 user nova-compute[75648]:   </cpu>
Nov 15 06:09:41 user nova-compute[75648]:   <devices>
Nov 15 06:09:41 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 06:09:41 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 06:09:41 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk"/>
Nov 15 06:09:41 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:09:41 user nova-compute[75648]:     </disk>
Nov 15 06:09:41 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:09:41 user nova-compute[75648]:       <mac address="fa:16:3e:92:8e:91"/>
Nov 15 06:09:41 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:09:41 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:09:41 user nova-compute[75648]:       <target dev="tapc557fae6-fb"/>
Nov 15 06:09:41 user nova-compute[75648]:     </interface>
Nov 15 06:09:41 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:09:41 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/console.log" append="off"/>
Nov 15 06:09:41 user nova-compute[75648]:     </serial>
Nov 15 06:09:41 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:09:41 user nova-compute[75648]:     <video>
Nov 15 06:09:41 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:09:41 user nova-compute[75648]:     </video>
Nov 15 06:09:41 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:09:41 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:09:41 user nova-compute[75648]:     </rng>
Nov 15 06:09:41 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:09:41 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:09:41 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:09:41 user nova-compute[75648]:     </memballoon>
Nov 15 06:09:41 user nova-compute[75648]:   </devices>
Nov 15 06:09:41 user nova-compute[75648]: </domain>
Nov 15 06:09:41 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-471477797',display_name='tempest-VolumesActionsTest-instance-471477797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-471477797',id=51,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c1c7c2127c1944e19cfdcd051525a3ef',ramdisk_id='',reservation_id='r-x0w9xpl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1219950169',owner_user_name='tempest-VolumesActionsTest-1219950169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:09:39Z,user_data=None,user_id='76cb329bb8fc415f8bda11dc4acad2fb',uuid=af22adcb-77ad-4c01-974c-0081c98cfc43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Converting VIF {"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG os_vif [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4005972e-cd9e-50fd-a40c-8ea92ef13cfc', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc557fae6-fb, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc557fae6-fb, col_values=(('qos', UUID('c3fa8962-74f6-4a74-8c11-114888701226')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc557fae6-fb, col_values=(('external_ids', {'iface-id': 'c557fae6-fb04-4b3d-be67-2b06fd2957f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:8e:91', 'vm-uuid': 'af22adcb-77ad-4c01-974c-0081c98cfc43'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:41 user nova-compute[75648]: INFO os_vif [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb')
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] No VIF found with MAC fa:16:3e:92:8e:91, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updated VIF entry in instance network info cache for port c557fae6-fb04-4b3d-be67-2b06fd2957f5. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG nova.network.neutron [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updating instance_info_cache with network_info: [{"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:09:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-f89ed830-34e4-4877-8e33-710e462c6a48 req-13dfc133-753e-470a-b608-dce6faaa09f7 service nova] Releasing lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-6456b300-4924-41be-9351-c2daa3012ef5 req-e129d91b-7537-4c41-94fd-91e504d1c348 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6456b300-4924-41be-9351-c2daa3012ef5 req-e129d91b-7537-4c41-94fd-91e504d1c348 service nova] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6456b300-4924-41be-9351-c2daa3012ef5 req-e129d91b-7537-4c41-94fd-91e504d1c348 service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6456b300-4924-41be-9351-c2daa3012ef5 req-e129d91b-7537-4c41-94fd-91e504d1c348 service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:42 user nova-compute[75648]: DEBUG nova.compute.manager [req-6456b300-4924-41be-9351-c2daa3012ef5 req-e129d91b-7537-4c41-94fd-91e504d1c348 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] No waiting events found dispatching network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:09:42 user nova-compute[75648]: WARNING nova.compute.manager [req-6456b300-4924-41be-9351-c2daa3012ef5 req-e129d91b-7537-4c41-94fd-91e504d1c348 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received unexpected event network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 for instance with vm_state building and task_state spawning.
Nov 15 06:09:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 06:09:44 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Instance spawned successfully.
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-56c3b4d4-982d-4592-b176-d033e73776fc req-14dc1fee-2a3b-4bd5-8cfc-9c77607b5db9 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-56c3b4d4-982d-4592-b176-d033e73776fc req-14dc1fee-2a3b-4bd5-8cfc-9c77607b5db9 service nova] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-56c3b4d4-982d-4592-b176-d033e73776fc req-14dc1fee-2a3b-4bd5-8cfc-9c77607b5db9 service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-56c3b4d4-982d-4592-b176-d033e73776fc req-14dc1fee-2a3b-4bd5-8cfc-9c77607b5db9 service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:44 user nova-compute[75648]: DEBUG nova.compute.manager [req-56c3b4d4-982d-4592-b176-d033e73776fc req-14dc1fee-2a3b-4bd5-8cfc-9c77607b5db9 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] No waiting events found dispatching network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:09:44 user nova-compute[75648]: WARNING nova.compute.manager [req-56c3b4d4-982d-4592-b176-d033e73776fc req-14dc1fee-2a3b-4bd5-8cfc-9c77607b5db9 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received unexpected event network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 for instance with vm_state building and task_state spawning.
Nov 15 06:09:45 user nova-compute[75648]: INFO nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 15 06:09:45 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:09:45 user nova-compute[75648]: INFO nova.compute.manager [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Took 6.00 seconds to build instance.
Nov 15 06:09:45 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b002f977-7c3a-4821-82b7-fb8a6ef52c50 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.096s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:09:46 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:51 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:56 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:09:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:01 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:06 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:11 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:11 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid af22adcb-77ad-4c01-974c-0081c98cfc43 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updating instance_info_cache with network_info: [{"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:10:13 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:10:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:15 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:16 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:10:16 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=25.185665130615234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance af22adcb-77ad-4c01-974c-0081c98cfc43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:10:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.466s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:10:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:21 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:21 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:26 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:31 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:31 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:31 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Starting instance... {{(pid=75648) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75648) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 15 06:10:32 user nova-compute[75648]: INFO nova.compute.claims [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Claim successful on node user
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Start building networks asynchronously for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Allocating IP information in the background. {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] allocate_for_instance() {{(pid=75648) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 15 06:10:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Start building block device mappings for instance. {{(pid=75648) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.policy [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e489cb76c59742efa12fb4036b9b817e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c6cb3c57f2b4d96a80f18c913356d4c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75648) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Start spawning the instance on the hypervisor. {{(pid=75648) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Creating instance directory {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 15 06:10:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Creating image(s)
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "/opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "/opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "/opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:32 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.185s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.176s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk 1073741824 {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a,backing_fmt=raw /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk 1073741824" returned: 0 in 0.054s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "314ff08e2f76bb827007aa25ff14fc0a90622a4a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Successfully created port: 053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a --force-share --output=json" returned: 0 in 0.184s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk. size=1073741824 {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.virt.disk.api [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Cannot resize image /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk to a smaller size. {{(pid=75648) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Created local disks {{(pid=75648) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Ensure instance console log exists: /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/console.log {{(pid=75648) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Successfully updated port: 053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquired lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:10:33 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Building network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Instance cache missing network info. {{(pid=75648) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-changed-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Refreshing instance network info cache due to event network-changed-053f3907-62a8-48bd-af7b-e9707bbb44f8. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] Acquiring lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.neutron [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Releasing lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Instance network_info: |[{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75648) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] Acquired lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Refreshing network info cache for port 053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Start _get_guest_xml network_info=[{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'size': 0, 'disk_bus': 'virtio', 'encryption_options': None, 'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'encryption_secret_uuid': None, 'image_id': '72e9a4f4-242e-472f-a069-4362bff1d397'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 15 06:10:34 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:10:34 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CPU controller missing on host. {{(pid=75648) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.host [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CPU controller found on host. {{(pid=75648) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75648) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-15T05:34:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-15T05:35:10Z,direct_url=<?>,disk_format='qcow2',id=72e9a4f4-242e-472f-a069-4362bff1d397,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c469ae6196ba4f5aa645e12724f2389d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-15T05:35:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Flavor limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Image limits 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Flavor pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Image pref 0:0:0 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75648) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Got 1 possible topologies {{(pid=75648) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.hardware [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75648) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-485759448',display_name='tempest-TestServerVolumeAttachmentScenario-server-485759448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-485759448',id=52,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaimAZoUR/nd0V46Fhy+Au7Msx1um2VJkhwFYy2e9A0NEoHX+nxDDWKWIxU9poj3KSoqmiC4dtCuAnlrJcyszLprXteC4O5MkGYr8+zsfTeOeN7b0zlv1Tto7z7IixQjQ==',key_name='tempest-keypair-1408887998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c6cb3c57f2b4d96a80f18c913356d4c',ramdisk_id='',reservation_id='r-mkgi9ch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-522528624',owner_user_name='tempest-TestServerVolumeAttachmentScenario-522528624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e489cb76c59742efa12fb4036b9b817e',uuid=a746bbec-8727-4d64-9a37-72cb007cfc17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75648) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Converting VIF {"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'pci_devices' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] End _get_guest_xml xml=<domain type="kvm">
Nov 15 06:10:34 user nova-compute[75648]:   <uuid>a746bbec-8727-4d64-9a37-72cb007cfc17</uuid>
Nov 15 06:10:34 user nova-compute[75648]:   <name>instance-00000034</name>
Nov 15 06:10:34 user nova-compute[75648]:   <memory>524288</memory>
Nov 15 06:10:34 user nova-compute[75648]:   <vcpu>1</vcpu>
Nov 15 06:10:34 user nova-compute[75648]:   <metadata>
Nov 15 06:10:34 user nova-compute[75648]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 15 06:10:34 user nova-compute[75648]:       <nova:package version="0.0.0"/>
Nov 15 06:10:34 user nova-compute[75648]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-485759448</nova:name>
Nov 15 06:10:34 user nova-compute[75648]:       <nova:creationTime>2023-11-15 06:10:34</nova:creationTime>
Nov 15 06:10:34 user nova-compute[75648]:       <nova:flavor name="m1.tiny">
Nov 15 06:10:34 user nova-compute[75648]:         <nova:memory>512</nova:memory>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:disk>1</nova:disk>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:swap>0</nova:swap>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:ephemeral>0</nova:ephemeral>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:vcpus>1</nova:vcpus>
Nov 15 06:10:34 user nova-compute[75648]:       </nova:flavor>
Nov 15 06:10:34 user nova-compute[75648]:       <nova:owner>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:user uuid="e489cb76c59742efa12fb4036b9b817e">tempest-TestServerVolumeAttachmentScenario-522528624-project-member</nova:user>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:project uuid="0c6cb3c57f2b4d96a80f18c913356d4c">tempest-TestServerVolumeAttachmentScenario-522528624</nova:project>
Nov 15 06:10:34 user nova-compute[75648]:       </nova:owner>
Nov 15 06:10:34 user nova-compute[75648]:       <nova:root type="image" uuid="72e9a4f4-242e-472f-a069-4362bff1d397"/>
Nov 15 06:10:34 user nova-compute[75648]:       <nova:ports>
Nov 15 06:10:34 user nova-compute[75648]:         <nova:port uuid="053f3907-62a8-48bd-af7b-e9707bbb44f8">
Nov 15 06:10:34 user nova-compute[75648]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 15 06:10:34 user nova-compute[75648]:         </nova:port>
Nov 15 06:10:34 user nova-compute[75648]:       </nova:ports>
Nov 15 06:10:34 user nova-compute[75648]:     </nova:instance>
Nov 15 06:10:34 user nova-compute[75648]:   </metadata>
Nov 15 06:10:34 user nova-compute[75648]:   <sysinfo type="smbios">
Nov 15 06:10:34 user nova-compute[75648]:     <system>
Nov 15 06:10:34 user nova-compute[75648]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 15 06:10:34 user nova-compute[75648]:       <entry name="product">OpenStack Nova</entry>
Nov 15 06:10:34 user nova-compute[75648]:       <entry name="version">0.0.0</entry>
Nov 15 06:10:34 user nova-compute[75648]:       <entry name="serial">a746bbec-8727-4d64-9a37-72cb007cfc17</entry>
Nov 15 06:10:34 user nova-compute[75648]:       <entry name="uuid">a746bbec-8727-4d64-9a37-72cb007cfc17</entry>
Nov 15 06:10:34 user nova-compute[75648]:       <entry name="family">Virtual Machine</entry>
Nov 15 06:10:34 user nova-compute[75648]:     </system>
Nov 15 06:10:34 user nova-compute[75648]:   </sysinfo>
Nov 15 06:10:34 user nova-compute[75648]:   <os>
Nov 15 06:10:34 user nova-compute[75648]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 15 06:10:34 user nova-compute[75648]:     <boot dev="hd"/>
Nov 15 06:10:34 user nova-compute[75648]:     <smbios mode="sysinfo"/>
Nov 15 06:10:34 user nova-compute[75648]:   </os>
Nov 15 06:10:34 user nova-compute[75648]:   <features>
Nov 15 06:10:34 user nova-compute[75648]:     <acpi/>
Nov 15 06:10:34 user nova-compute[75648]:     <apic/>
Nov 15 06:10:34 user nova-compute[75648]:     <vmcoreinfo/>
Nov 15 06:10:34 user nova-compute[75648]:   </features>
Nov 15 06:10:34 user nova-compute[75648]:   <clock offset="utc">
Nov 15 06:10:34 user nova-compute[75648]:     <timer name="pit" tickpolicy="delay"/>
Nov 15 06:10:34 user nova-compute[75648]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 15 06:10:34 user nova-compute[75648]:     <timer name="hpet" present="no"/>
Nov 15 06:10:34 user nova-compute[75648]:   </clock>
Nov 15 06:10:34 user nova-compute[75648]:   <cpu mode="custom" match="exact">
Nov 15 06:10:34 user nova-compute[75648]:     <model>Nehalem</model>
Nov 15 06:10:34 user nova-compute[75648]:     <topology sockets="1" cores="1" threads="1"/>
Nov 15 06:10:34 user nova-compute[75648]:   </cpu>
Nov 15 06:10:34 user nova-compute[75648]:   <devices>
Nov 15 06:10:34 user nova-compute[75648]:     <disk type="file" device="disk">
Nov 15 06:10:34 user nova-compute[75648]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 15 06:10:34 user nova-compute[75648]:       <source file="/opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk"/>
Nov 15 06:10:34 user nova-compute[75648]:       <target dev="vda" bus="virtio"/>
Nov 15 06:10:34 user nova-compute[75648]:     </disk>
Nov 15 06:10:34 user nova-compute[75648]:     <interface type="ethernet">
Nov 15 06:10:34 user nova-compute[75648]:       <mac address="fa:16:3e:63:68:9b"/>
Nov 15 06:10:34 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:10:34 user nova-compute[75648]:       <mtu size="1442"/>
Nov 15 06:10:34 user nova-compute[75648]:       <target dev="tap053f3907-62"/>
Nov 15 06:10:34 user nova-compute[75648]:     </interface>
Nov 15 06:10:34 user nova-compute[75648]:     <serial type="pty">
Nov 15 06:10:34 user nova-compute[75648]:       <log file="/opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/console.log" append="off"/>
Nov 15 06:10:34 user nova-compute[75648]:     </serial>
Nov 15 06:10:34 user nova-compute[75648]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 15 06:10:34 user nova-compute[75648]:     <video>
Nov 15 06:10:34 user nova-compute[75648]:       <model type="virtio"/>
Nov 15 06:10:34 user nova-compute[75648]:     </video>
Nov 15 06:10:34 user nova-compute[75648]:     <rng model="virtio">
Nov 15 06:10:34 user nova-compute[75648]:       <backend model="random">/dev/urandom</backend>
Nov 15 06:10:34 user nova-compute[75648]:     </rng>
Nov 15 06:10:34 user nova-compute[75648]:     <controller type="usb" index="0" model="none"/>
Nov 15 06:10:34 user nova-compute[75648]:     <memballoon model="virtio">
Nov 15 06:10:34 user nova-compute[75648]:       <stats period="10"/>
Nov 15 06:10:34 user nova-compute[75648]:     </memballoon>
Nov 15 06:10:34 user nova-compute[75648]:   </devices>
Nov 15 06:10:34 user nova-compute[75648]: </domain>
Nov 15 06:10:34 user nova-compute[75648]:  {{(pid=75648) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-485759448',display_name='tempest-TestServerVolumeAttachmentScenario-server-485759448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-485759448',id=52,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaimAZoUR/nd0V46Fhy+Au7Msx1um2VJkhwFYy2e9A0NEoHX+nxDDWKWIxU9poj3KSoqmiC4dtCuAnlrJcyszLprXteC4O5MkGYr8+zsfTeOeN7b0zlv1Tto7z7IixQjQ==',key_name='tempest-keypair-1408887998',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c6cb3c57f2b4d96a80f18c913356d4c',ramdisk_id='',reservation_id='r-mkgi9ch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-522528624',owner_user_name='tempest-TestServerVolumeAttachmentScenario-522528624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-15T06:10:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e489cb76c59742efa12fb4036b9b817e',uuid=a746bbec-8727-4d64-9a37-72cb007cfc17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Converting VIF {"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG os_vif [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62') {{(pid=75648) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76909634-ef30-5766-acf7-8763120373fe', '_type': 'linux-noop'}}, row=False) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap053f3907-62, may_exist=True, interface_attrs={}) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap053f3907-62, col_values=(('qos', UUID('271a2613-b9b9-497d-8074-01b7874399cf')),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap053f3907-62, col_values=(('external_ids', {'iface-id': '053f3907-62a8-48bd-af7b-e9707bbb44f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:68:9b', 'vm-uuid': 'a746bbec-8727-4d64-9a37-72cb007cfc17'}),), if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:34 user nova-compute[75648]: INFO os_vif [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62')
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No VIF found with MAC fa:16:3e:63:68:9b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updated VIF entry in instance network info cache for port 053f3907-62a8-48bd-af7b-e9707bbb44f8. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG nova.network.neutron [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:10:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de605d2f-b665-4072-9e54-16d669669df9 req-09343094-65b2-477e-baec-548190dd507d service nova] Releasing lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:10:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:35 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-b3277cae-9ee4-4523-8b31-ddd8f39c240e req-812ea7de-f73c-44ca-b1e7-de664e51e968 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b3277cae-9ee4-4523-8b31-ddd8f39c240e req-812ea7de-f73c-44ca-b1e7-de664e51e968 service nova] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b3277cae-9ee4-4523-8b31-ddd8f39c240e req-812ea7de-f73c-44ca-b1e7-de664e51e968 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-b3277cae-9ee4-4523-8b31-ddd8f39c240e req-812ea7de-f73c-44ca-b1e7-de664e51e968 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-b3277cae-9ee4-4523-8b31-ddd8f39c240e req-812ea7de-f73c-44ca-b1e7-de664e51e968 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] No waiting events found dispatching network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:10:36 user nova-compute[75648]: WARNING nova.compute.manager [req-b3277cae-9ee4-4523-8b31-ddd8f39c240e req-812ea7de-f73c-44ca-b1e7-de664e51e968 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received unexpected event network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 for instance with vm_state building and task_state spawning.
Nov 15 06:10:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:36 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Instance event wait completed in 0 seconds for  {{(pid=75648) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Guest created on hypervisor {{(pid=75648) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 15 06:10:38 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Instance spawned successfully.
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Found default for hw_cdrom_bus of ide {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Found default for hw_disk_bus of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Found default for hw_input_bus of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Found default for hw_pointer_model of None {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Found default for hw_video_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Found default for hw_vif_model of virtio {{(pid=75648) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 15 06:10:38 user nova-compute[75648]: INFO nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Checking state {{(pid=75648) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-69d303c6-465e-4ed9-a8de-e788216b7d5b req-5224b176-fd3f-480b-b96e-20b51eef1079 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69d303c6-465e-4ed9-a8de-e788216b7d5b req-5224b176-fd3f-480b-b96e-20b51eef1079 service nova] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69d303c6-465e-4ed9-a8de-e788216b7d5b req-5224b176-fd3f-480b-b96e-20b51eef1079 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-69d303c6-465e-4ed9-a8de-e788216b7d5b req-5224b176-fd3f-480b-b96e-20b51eef1079 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.compute.manager [req-69d303c6-465e-4ed9-a8de-e788216b7d5b req-5224b176-fd3f-480b-b96e-20b51eef1079 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] No waiting events found dispatching network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:10:38 user nova-compute[75648]: WARNING nova.compute.manager [req-69d303c6-465e-4ed9-a8de-e788216b7d5b req-5224b176-fd3f-480b-b96e-20b51eef1079 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received unexpected event network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 for instance with vm_state building and task_state spawning.
Nov 15 06:10:38 user nova-compute[75648]: INFO nova.compute.manager [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Took 5.94 seconds to build instance.
Nov 15 06:10:38 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-f6fb13b6-0562-445d-a99c-1082ed79e150 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.041s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 06:10:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 06:10:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:10:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid af22adcb-77ad-4c01-974c-0081c98cfc43 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updating instance_info_cache with network_info: [{"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-af22adcb-77ad-4c01-974c-0081c98cfc43" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:11:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:11:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:11:16 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:11:17 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:11:17 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.154930114746094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance af22adcb-77ad-4c01-974c-0081c98cfc43 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance a746bbec-8727-4d64-9a37-72cb007cfc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:11:17 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:11:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:11:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:11:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:11:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:34 user nova-compute[75648]: INFO nova.compute.manager [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Terminating instance
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.compute.manager [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-adea3689-861d-4154-b69c-0f6755437a48 req-28c79e1e-20d2-49f8-a32f-772c007dd8ae service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-vif-unplugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-adea3689-861d-4154-b69c-0f6755437a48 req-28c79e1e-20d2-49f8-a32f-772c007dd8ae service nova] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-adea3689-861d-4154-b69c-0f6755437a48 req-28c79e1e-20d2-49f8-a32f-772c007dd8ae service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-adea3689-861d-4154-b69c-0f6755437a48 req-28c79e1e-20d2-49f8-a32f-772c007dd8ae service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-adea3689-861d-4154-b69c-0f6755437a48 req-28c79e1e-20d2-49f8-a32f-772c007dd8ae service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] No waiting events found dispatching network-vif-unplugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.compute.manager [req-adea3689-861d-4154-b69c-0f6755437a48 req-28c79e1e-20d2-49f8-a32f-772c007dd8ae service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-vif-unplugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Instance destroyed successfully.
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lazy-loading 'resources' on Instance uuid af22adcb-77ad-4c01-974c-0081c98cfc43 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:09:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-471477797',display_name='tempest-VolumesActionsTest-instance-471477797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-471477797',id=51,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:09:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c1c7c2127c1944e19cfdcd051525a3ef',ramdisk_id='',reservation_id='r-x0w9xpl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1219950169',owner_user_name='tempest-VolumesActionsTest-1219950169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:09:45Z,user_data=None,user_id='76cb329bb8fc415f8bda11dc4acad2fb',uuid=af22adcb-77ad-4c01-974c-0081c98cfc43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Converting VIF {"id": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "address": "fa:16:3e:92:8e:91", "network": {"id": "1ce180f5-45f0-4df8-9d1a-d7039c03e9b5", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1588396769-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c1c7c2127c1944e19cfdcd051525a3ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc557fae6-fb", "ovs_interfaceid": "c557fae6-fb04-4b3d-be67-2b06fd2957f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG os_vif [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc557fae6-fb, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3fa8962-74f6-4a74-8c11-114888701226) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:11:34 user nova-compute[75648]: INFO os_vif [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:8e:91,bridge_name='br-int',has_traffic_filtering=True,id=c557fae6-fb04-4b3d-be67-2b06fd2957f5,network=Network(1ce180f5-45f0-4df8-9d1a-d7039c03e9b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc557fae6-fb')
Nov 15 06:11:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Deleting instance files /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43_del
Nov 15 06:11:34 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Deletion of /opt/stack/data/nova/instances/af22adcb-77ad-4c01-974c-0081c98cfc43_del complete
Nov 15 06:11:34 user nova-compute[75648]: INFO nova.compute.manager [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 15 06:11:34 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:11:34 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:11:35 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:11:35 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Took 0.40 seconds to deallocate network for instance.
Nov 15 06:11:35 user nova-compute[75648]: DEBUG nova.compute.manager [req-415d0956-4ab4-4391-a646-4a9473e14443 req-e15db59f-46a1-4dea-b916-80b6243d0a85 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-vif-deleted-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:11:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:35 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:11:35 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:11:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:35 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Deleted allocations for instance af22adcb-77ad-4c01-974c-0081c98cfc43
Nov 15 06:11:35 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-b21cc10d-2efd-4856-9e05-6bef9a574366 tempest-VolumesActionsTest-1219950169 tempest-VolumesActionsTest-1219950169-project-member] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.553s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-de3da46c-4f02-4178-9627-d8da951f6979 req-7f31ed13-8283-4e71-a8ea-398d10173de6 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received event network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:11:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de3da46c-4f02-4178-9627-d8da951f6979 req-7f31ed13-8283-4e71-a8ea-398d10173de6 service nova] Acquiring lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:11:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de3da46c-4f02-4178-9627-d8da951f6979 req-7f31ed13-8283-4e71-a8ea-398d10173de6 service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:11:36 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-de3da46c-4f02-4178-9627-d8da951f6979 req-7f31ed13-8283-4e71-a8ea-398d10173de6 service nova] Lock "af22adcb-77ad-4c01-974c-0081c98cfc43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:11:36 user nova-compute[75648]: DEBUG nova.compute.manager [req-de3da46c-4f02-4178-9627-d8da951f6979 req-7f31ed13-8283-4e71-a8ea-398d10173de6 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] No waiting events found dispatching network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:11:36 user nova-compute[75648]: WARNING nova.compute.manager [req-de3da46c-4f02-4178-9627-d8da951f6979 req-7f31ed13-8283-4e71-a8ea-398d10173de6 service nova] [instance: af22adcb-77ad-4c01-974c-0081c98cfc43] Received unexpected event network-vif-plugged-c557fae6-fb04-4b3d-be67-2b06fd2957f5 for instance with vm_state deleted and task_state None.
Nov 15 06:11:37 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:11:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:11:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:12 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75648) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75648) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:12:14 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:12:15 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:17 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:12:18 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=8993MB free_disk=25.174114227294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance a746bbec-8727-4d64-9a37-72cb007cfc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:12:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:12:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:12:22 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:22 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:22 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:12:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-changed-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Refreshing instance network info cache due to event network-changed-053f3907-62a8-48bd-af7b-e9707bbb44f8. {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] Acquiring lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] Acquired lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG nova.network.neutron [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Refreshing network info cache for port 053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG nova.network.neutron [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updated VIF entry in instance network info cache for port 053f3907-62a8-48bd-af7b-e9707bbb44f8. {{(pid=75648) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG nova.network.neutron [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-aab0ed30-d13b-495d-b974-7f8da57cebb6 req-5eb0b818-669c-480f-8b5b-100c2fbd5ed5 service nova] Releasing lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'flavor' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:12:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:24 user nova-compute[75648]: INFO nova.compute.manager [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attaching volume 56fe2d4a-c313-42f3-b0b2-17294f78ca6d to /dev/vdb
Nov 15 06:12:24 user nova-compute[75648]: DEBUG os_brick.utils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[331ef14e-f620-4572-95f5-e4139a620fa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c6a1db-bec1-41d0-9d6b-053418d92ddd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5807a-3908-4e86-a218-3cbb469bbbac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2195c2-f31c-4d08-b37f-6a51ac44264e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:12:24 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:12:24 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6568d97-b6f6-49b2-82a2-99a9a1d28805]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG os_brick.utils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating existing volume attachment record: cf4c0bfe-fa7b-4331-9f82-ed6923a42515 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:12:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIrLgiWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:12:28 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:12:28 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:12:28 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4778bbe9-3cff-41f5-9892-28db92a922d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:12:28 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d4cb73-ff5e-48e2-a81e-3e1277152d23]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d] added
Nov 15 06:12:28 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd09e4-1934-46a4-ab3c-a1d32ad482e7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36c4018-0bbb-4185-8e12-f57a054a8df7]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIrLgiWZ {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wIrLgiWZ" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7ad7bc-11ae-47b2-a860-c5efecc722fc]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:28 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wIrLgiWZ'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fb628e-8eb3-4575-a4f7-a1f08ef26fad]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[761fa039-ad59-41d5-9c40-9ef000d19d63]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 15 06:12:29 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 15 06:12:29 user nova-compute[75648]:  {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:12:29 user nova-compute[75648]: WARNING os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 15 06:12:29 user nova-compute[75648]: 
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ed5c98-1cd1-4260-9dc9-b77daacbd313]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260]
Nov 15 06:12:29 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260] successful.
Nov 15 06:12:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5529364d-6ae1-4ddc-8f17-776da7963526]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[508217fa-a3ac-48f1-b249-1cb1267390f3]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:12:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:12:29 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7868f97-eac5-4318-b3b1-2d8a75bcd161]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:12:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIrLgiWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '23764666266393832', 'path': '/dev/sdb'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764666266393832', 'path': '/dev/sdb'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG nova.objects.instance [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'flavor' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:12:30 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:12:30 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 06:12:30 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:12:30 user nova-compute[75648]:   <serial>56fe2d4a-c313-42f3-b0b2-17294f78ca6d</serial>
Nov 15 06:12:30 user nova-compute[75648]: </disk>
Nov 15 06:12:30 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No VIF found with MAC fa:16:3e:63:68:9b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:12:30 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-c9467be6-2d17-46ac-8235-c064bdd5f32f tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.504s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG nova.objects.instance [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'flavor' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:34 user nova-compute[75648]: INFO nova.compute.manager [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attaching volume f6c4037f-285d-4de0-bc8c-bc5a9041dc0f to /dev/vdc
Nov 15 06:12:34 user nova-compute[75648]: DEBUG os_brick.utils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[5264f2b6-e217-40e9-aa8c-a4942c3efd6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:38d88128ebb7\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b353e6-251b-4abd-80c4-cc5dae77c1ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2407900d-eab1-4c0e-a068-35d3963e3e43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d521a4-ac33-4efc-8d12-41b6e0e361d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Running cmd (subprocess): nvme version {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] 'nvme version' failed. Not Retrying. {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.nvmeof [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] nvme not present on system {{(pid=75648) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 15 06:12:34 user nova-compute[75648]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 15 06:12:34 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f70e4a5-15c6-4a50-9db7-46cc7879c150]: (4, '') {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75648) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.lightos [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] LIGHTOS: no hostnqn found. {{(pid=75648) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG os_brick.utils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:38d88128ebb7', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG nova.virt.block_device [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating existing volume attachment record: 15694911-47f1-420c-b14a-adad69e7ad15 {{(pid=75648) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 15 06:12:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Calling os-brick to attach iSCSI Volume {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuHTGdIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:12:38 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:12:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:12:38 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:12:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:12:38 user nova-compute[75648]: INFO os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 15 06:12:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48a4993-0e37-49da-af13-7ae711a329a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 15 06:12:38 user nova-compute[75648]:  {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:38 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --interface default --op new {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b820a438-5eef-4fe7-9e42-fc5fb4e8298a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f] added\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f] added
Nov 15 06:12:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f16f60-6c57-4e91-b95a-d03bea0a785a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9da16d2-99c4-4c78-97df-0a56d6d2c857]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuHTGdIW {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuHTGdIW" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5db57f-15d9-4c32-b620-c1114c86844c]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuHTGdIW'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b108667-06e5-48db-baeb-143a9c4c2c45]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d06085-f8e9-4b37-830d-2d8e18b51300]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:12:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:12:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --login {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[7648c0a8-6f49-4f41-bdc6-62e8af9efab4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260]
Nov 15 06:12:39 user nova-compute[75648]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260] successful.
Nov 15 06:12:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[80154983-99a7-4061-8508-55aa8ce99a6d]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76496a1-11f1-43be-b132-b9ebae350683]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:12:39 user nova-compute[75648]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f (non-flash)
Nov 15 06:12:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:12:39 user nova-compute[75648]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f (non-flash)
Nov 15 06:12:39 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Connected to 172.16.0.220:3260 {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=75648) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75648) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5659a5-227e-4045-b8d6-45278a8b5494]: (4, ('- - 0', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75648) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuHTGdIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75648) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 15 06:12:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23038616163663836', 'path': '/dev/sdc'} {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038616163663836', 'path': '/dev/sdc'} {{(pid=75648) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.objects.instance [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'flavor' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] attach device xml: <disk type="block" device="disk">
Nov 15 06:12:40 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:12:40 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:12:40 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 06:12:40 user nova-compute[75648]:   <serial>f6c4037f-285d-4de0-bc8c-bc5a9041dc0f</serial>
Nov 15 06:12:40 user nova-compute[75648]: </disk>
Nov 15 06:12:40 user nova-compute[75648]:  {{(pid=75648) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75648) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 15 06:12:40 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] No VIF found with MAC fa:16:3e:63:68:9b, not building metadata {{(pid=75648) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 15 06:12:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-886fea98-2210-4181-a908-a7518906bd7d tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.827s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:12:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:12:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:12:41 user nova-compute[75648]: INFO nova.compute.manager [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Detaching volume f6c4037f-285d-4de0-bc8c-bc5a9041dc0f
Nov 15 06:12:41 user nova-compute[75648]: INFO nova.virt.block_device [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attempting to driver detach volume f6c4037f-285d-4de0-bc8c-bc5a9041dc0f from mountpoint /dev/vdc
Nov 15 06:12:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Attempting to detach device vdc from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:12:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:12:41 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:12:41 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:12:41 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 06:12:41 user nova-compute[75648]:   <serial>f6c4037f-285d-4de0-bc8c-bc5a9041dc0f</serial>
Nov 15 06:12:41 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 06:12:41 user nova-compute[75648]: </disk>
Nov 15 06:12:41 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:12:41 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Successfully detached device vdc from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the persistent domain config.
Nov 15 06:12:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:12:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:12:41 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:12:41 user nova-compute[75648]:   <source dev="/dev/sdc"/>
Nov 15 06:12:41 user nova-compute[75648]:   <target dev="vdc" bus="virtio"/>
Nov 15 06:12:41 user nova-compute[75648]:   <serial>f6c4037f-285d-4de0-bc8c-bc5a9041dc0f</serial>
Nov 15 06:12:41 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 15 06:12:41 user nova-compute[75648]: </disk>
Nov 15 06:12:41 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:12:42 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:12:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:45 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:12:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:13:02 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a746bbec-8727-4d64-9a37-72cb007cfc17 is timed out.
Nov 15 06:13:02 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Successfully detached device vdc from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the live domain config.
Nov 15 06:13:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuHTGdIW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:13:02 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fc6506-ed25-488a-a540-17c64ddf50df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:13:02 user nova-compute[75648]: No targets found.
Nov 15 06:13:02 user nova-compute[75648]: iSNS:
Nov 15 06:13:02 user nova-compute[75648]: No targets found.
Nov 15 06:13:02 user nova-compute[75648]: STATIC:
Nov 15 06:13:02 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f
Nov 15 06:13:02 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:13:02 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:13:02 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d
Nov 15 06:13:02 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:13:02 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:13:02 user nova-compute[75648]: FIRMWARE:
Nov 15 06:13:02 user nova-compute[75648]: No targets found.
Nov 15 06:13:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:13:02 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:13:02 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01e82e6-67ac-4d0e-a222-72eed98acbef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[2980953b-b16a-4dfd-b7af-6028d421c2d8]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:13:02 user nova-compute[75648]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f (non-flash)
Nov 15 06:13:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:13:02 user nova-compute[75648]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f (non-flash)
Nov 15 06:13:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c47b9990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f'): ({'sdc'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Removing single pathed devices sdc {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[a758830b-c538-423a-a6cd-be445323eb72]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f1acc9-b792-46d5-874c-bb0e2e3d084b]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Flushing IO for device /dev/sdc {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[248d59f6-f0f1-459a-9fec-f865f55aeb4b]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[f75a31fc-45ee-4a13-992f-6416148e9d17]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] SCSI volumes sdc have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d88f68-59ab-4004-973c-00c96a918f4e]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc397eeb-652a-46b0-b55b-92d7a7b11b09]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260]
Nov 15 06:13:02 user nova-compute[75648]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f, portal: 172.16.0.220,3260] successful.
Nov 15 06:13:02 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6c4037f-285d-4de0-bc8c-bc5a9041dc0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[04644aab-c9fe-4f9b-8bd3-27497d49e1f6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] <== disconnect_volume: return (273ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:13:02 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:13:03 user nova-compute[75648]: DEBUG nova.objects.instance [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'flavor' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:13:03 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-d4d6bef5-ff6c-43ef-b96c-e5a65e8e8eba tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.593s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:13:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:13:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:13:13 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:13:16 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:13:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:18 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75648) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 15 06:13:19 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:13:19 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=9066MB free_disk=25.171104431152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance a746bbec-8727-4d64-9a37-72cb007cfc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:13:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:13:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:23 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:13:24 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:13:29 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:13:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:13:32 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:13:32 user nova-compute[75648]: INFO nova.compute.manager [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Detaching volume 56fe2d4a-c313-42f3-b0b2-17294f78ca6d
Nov 15 06:13:32 user nova-compute[75648]: INFO nova.virt.block_device [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Attempting to driver detach volume 56fe2d4a-c313-42f3-b0b2-17294f78ca6d from mountpoint /dev/vdb
Nov 15 06:13:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Attempting to detach device vdb from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the persistent domain config. {{(pid=75648) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 15 06:13:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:13:32 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:13:32 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 06:13:32 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:13:32 user nova-compute[75648]:   <serial>56fe2d4a-c313-42f3-b0b2-17294f78ca6d</serial>
Nov 15 06:13:32 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:13:32 user nova-compute[75648]: </disk>
Nov 15 06:13:32 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:13:32 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Successfully detached device vdb from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the persistent domain config.
Nov 15 06:13:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the live domain config. {{(pid=75648) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 15 06:13:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.guest [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] detach device xml: <disk type="block" device="disk">
Nov 15 06:13:32 user nova-compute[75648]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 15 06:13:32 user nova-compute[75648]:   <source dev="/dev/sdb"/>
Nov 15 06:13:32 user nova-compute[75648]:   <target dev="vdb" bus="virtio"/>
Nov 15 06:13:32 user nova-compute[75648]:   <serial>56fe2d4a-c313-42f3-b0b2-17294f78ca6d</serial>
Nov 15 06:13:32 user nova-compute[75648]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 15 06:13:32 user nova-compute[75648]: </disk>
Nov 15 06:13:32 user nova-compute[75648]:  {{(pid=75648) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 15 06:13:32 user nova-compute[75648]: DEBUG nova.virt.libvirt.driver [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 15 06:13:34 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:13:39 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:13:39 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:13:44 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:13:49 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:13:52 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a746bbec-8727-4d64-9a37-72cb007cfc17 is timed out.
Nov 15 06:13:52 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Successfully detached device vdb from instance a746bbec-8727-4d64-9a37-72cb007cfc17 from the live domain config.
Nov 15 06:13:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] calling os-brick to detach iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fe9e84b9540>, {'target_iqn': 'iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wIrLgiWZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 15 06:13:52 user nova-compute[75648]: WARNING os_brick.initiator.connectors.base [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d1556c-a280-41a7-b40d-3a86caafec69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 15 06:13:52 user nova-compute[75648]: No targets found.
Nov 15 06:13:52 user nova-compute[75648]: iSNS:
Nov 15 06:13:52 user nova-compute[75648]: No targets found.
Nov 15 06:13:52 user nova-compute[75648]: STATIC:
Nov 15 06:13:52 user nova-compute[75648]: Target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d
Nov 15 06:13:52 user nova-compute[75648]:         Portal: 172.16.0.220:3260,-1
Nov 15 06:13:52 user nova-compute[75648]:                 Iface Name: default
Nov 15 06:13:52 user nova-compute[75648]: FIRMWARE:
Nov 15 06:13:52 user nova-compute[75648]: No targets found.
Nov 15 06:13:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 15 06:13:52 user nova-compute[75648]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 15 06:13:52 user nova-compute[75648]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75648) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d', 0)] {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9e8e42-4857-4a81-862d-ab6a49891d9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce098afe-f474-4e11-89cc-a7ffbe086110]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:13:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d (non-flash)
Nov 15 06:13:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fe9c451a5f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d'): ({'sdb'}, set())}) {{(pid=75648) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Removing single pathed devices sdb {{(pid=75648) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[904f4750-18d5-4160-a634-3cef76412c31]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[edfa920e-5a5e-4c93-b0e2-798481d120c9]: (4, ('ok\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Flushing IO for device /dev/sdb {{(pid=75648) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4697280a-13ca-4a59-8a4c-643a0889f4a6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75648) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[60585b3b-ea09-46df-99c3-a2c7be7875aa]: (4, ('1', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.linuxscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] SCSI volumes sdb have been removed. {{(pid=75648) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d')] {{(pid=75648) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02dbe12-567f-4431-89c9-b5fe0bdb70f6]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --logout {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eebebf5-6879-4a1e-aa10-8ac3cad01ab4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260]
Nov 15 06:13:52 user nova-compute[75648]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d, portal: 172.16.0.220,3260] successful.
Nov 15 06:13:52 user nova-compute[75648]:  stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op delete {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:56fe2d4a-c313-42f3-b0b2-17294f78ca6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=87015) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8dc97b8-0a47-45f7-9e18-76f082bb6e9a]: (4, ('', '')) {{(pid=87015) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75648) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.base [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] <== disconnect_volume: return (293ms) None {{(pid=75648) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 15 06:13:52 user nova-compute[75648]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Disconnected iSCSI Volume {{(pid=75648) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 15 06:13:53 user nova-compute[75648]: DEBUG nova.objects.instance [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'flavor' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:13:53 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-2e607318-6da6-48f3-a3f0-efc226c3d361 tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.670s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:13:54 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:13:59 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:04 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:09 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:14 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:17 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquired lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Forcefully refreshing network info cache for instance {{(pid=75648) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 15 06:14:18 user nova-compute[75648]: DEBUG nova.objects.instance [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lazy-loading 'info_cache' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG nova.network.neutron [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [{"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Releasing lock "refresh_cache-a746bbec-8727-4d64-9a37-72cb007cfc17" {{(pid=75648) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updated the network info_cache for instance {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.processutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75648) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 15 06:14:19 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:14:19 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:14:19 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=25.170413970947266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:19 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Instance a746bbec-8727-4d64-9a37-72cb007cfc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75648) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:14:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:22 user nova-compute[75648]: INFO nova.compute.manager [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Terminating instance
Nov 15 06:14:22 user nova-compute[75648]: DEBUG nova.compute.manager [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Start destroying the instance on the hypervisor. {{(pid=75648) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-3c67b1b6-1008-4fed-add0-51b51be9fc16 req-4a9dbd3f-8885-4dd2-bd2c-e5455b72edd7 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-vif-unplugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3c67b1b6-1008-4fed-add0-51b51be9fc16 req-4a9dbd3f-8885-4dd2-bd2c-e5455b72edd7 service nova] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3c67b1b6-1008-4fed-add0-51b51be9fc16 req-4a9dbd3f-8885-4dd2-bd2c-e5455b72edd7 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-3c67b1b6-1008-4fed-add0-51b51be9fc16 req-4a9dbd3f-8885-4dd2-bd2c-e5455b72edd7 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-3c67b1b6-1008-4fed-add0-51b51be9fc16 req-4a9dbd3f-8885-4dd2-bd2c-e5455b72edd7 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] No waiting events found dispatching network-vif-unplugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG nova.compute.manager [req-3c67b1b6-1008-4fed-add0-51b51be9fc16 req-4a9dbd3f-8885-4dd2-bd2c-e5455b72edd7 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-vif-unplugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 for instance with task_state deleting. {{(pid=75648) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 15 06:14:22 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [-] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Instance destroyed successfully.
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.objects.instance [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lazy-loading 'resources' on Instance uuid a746bbec-8727-4d64-9a37-72cb007cfc17 {{(pid=75648) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.virt.libvirt.vif [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-15T06:10:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-485759448',display_name='tempest-TestServerVolumeAttachmentScenario-server-485759448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-485759448',id=52,image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFaimAZoUR/nd0V46Fhy+Au7Msx1um2VJkhwFYy2e9A0NEoHX+nxDDWKWIxU9poj3KSoqmiC4dtCuAnlrJcyszLprXteC4O5MkGYr8+zsfTeOeN7b0zlv1Tto7z7IixQjQ==',key_name='tempest-keypair-1408887998',keypairs=<?>,launch_index=0,launched_at=2023-11-15T06:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c6cb3c57f2b4d96a80f18c913356d4c',ramdisk_id='',reservation_id='r-mkgi9ch7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='72e9a4f4-242e-472f-a069-4362bff1d397',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-522528624',owner_user_name='tempest-TestServerVolumeAttachmentScenario-522528624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-15T06:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e489cb76c59742efa12fb4036b9b817e',uuid=a746bbec-8727-4d64-9a37-72cb007cfc17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Converting VIF {"id": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "address": "fa:16:3e:63:68:9b", "network": {"id": "9ff25c07-c336-400a-9023-67278d445dbf", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1027377742-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c6cb3c57f2b4d96a80f18c913356d4c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap053f3907-62", "ovs_interfaceid": "053f3907-62a8-48bd-af7b-e9707bbb44f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.network.os_vif_util [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62') {{(pid=75648) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG os_vif [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62') {{(pid=75648) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap053f3907-62, bridge=br-int, if_exists=True) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=271a2613-b9b9-497d-8074-01b7874399cf) {{(pid=75648) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:23 user nova-compute[75648]: INFO os_vif [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:68:9b,bridge_name='br-int',has_traffic_filtering=True,id=053f3907-62a8-48bd-af7b-e9707bbb44f8,network=Network(9ff25c07-c336-400a-9023-67278d445dbf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap053f3907-62')
Nov 15 06:14:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Deleting instance files /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17_del
Nov 15 06:14:23 user nova-compute[75648]: INFO nova.virt.libvirt.driver [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Deletion of /opt/stack/data/nova/instances/a746bbec-8727-4d64-9a37-72cb007cfc17_del complete
Nov 15 06:14:23 user nova-compute[75648]: INFO nova.compute.manager [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 15 06:14:23 user nova-compute[75648]: DEBUG oslo.service.loopingcall [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75648) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.compute.manager [-] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Deallocating network for instance {{(pid=75648) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] deallocate_for_instance() {{(pid=75648) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.network.neutron [-] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Updating instance_info_cache with network_info: [] {{(pid=75648) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 15 06:14:23 user nova-compute[75648]: INFO nova.compute.manager [-] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Took 0.65 seconds to deallocate network for instance.
Nov 15 06:14:23 user nova-compute[75648]: DEBUG nova.compute.manager [req-b85dd0a2-f1db-46cc-bc06-4a1bc708b9fa req-e1442796-5821-4a55-82b4-bc852019d40e service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-vif-deleted-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:23 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:24 user nova-compute[75648]: INFO nova.scheduler.client.report [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Deleted allocations for instance a746bbec-8727-4d64-9a37-72cb007cfc17
Nov 15 06:14:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-ef5e4e74-2ff0-450a-a34c-66cbf3b12f7a tempest-TestServerVolumeAttachmentScenario-522528624 tempest-TestServerVolumeAttachmentScenario-522528624-project-member] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.821s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-6df7ca5f-ce0a-41da-bd3c-69e59ed1fdbc req-b89c8ff2-69c4-4850-bb12-e51676b62a44 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received event network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6df7ca5f-ce0a-41da-bd3c-69e59ed1fdbc req-b89c8ff2-69c4-4850-bb12-e51676b62a44 service nova] Acquiring lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6df7ca5f-ce0a-41da-bd3c-69e59ed1fdbc req-b89c8ff2-69c4-4850-bb12-e51676b62a44 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [req-6df7ca5f-ce0a-41da-bd3c-69e59ed1fdbc req-b89c8ff2-69c4-4850-bb12-e51676b62a44 service nova] Lock "a746bbec-8727-4d64-9a37-72cb007cfc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:24 user nova-compute[75648]: DEBUG nova.compute.manager [req-6df7ca5f-ce0a-41da-bd3c-69e59ed1fdbc req-b89c8ff2-69c4-4850-bb12-e51676b62a44 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] No waiting events found dispatching network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 {{(pid=75648) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 15 06:14:24 user nova-compute[75648]: WARNING nova.compute.manager [req-6df7ca5f-ce0a-41da-bd3c-69e59ed1fdbc req-b89c8ff2-69c4-4850-bb12-e51676b62a44 service nova] [instance: a746bbec-8727-4d64-9a37-72cb007cfc17] Received unexpected event network-vif-plugged-053f3907-62a8-48bd-af7b-e9707bbb44f8 for instance with vm_state deleted and task_state None.
Nov 15 06:14:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:14:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Verify base images {{(pid=75648) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0
Nov 15 06:14:41 user nova-compute[75648]: WARNING nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Unknown base file: /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Removable base files: /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7 /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9 /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173 /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894 /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57 /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0 /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9fc9116a02ae19fd286203f16621e8b413d4f7dd
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4f133114b5201e22b2d4e53700563f9bf081e1d7
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bec705b70844698fe08baa474216d6abd4b050a9
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/729c557b01c39123e38323583d78469c87351173
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f6af9e72bc55a7614397455fc5be4b8aa737307e
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/314ff08e2f76bb827007aa25ff14fc0a90622a4a
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e078624bf5c769691f29ddf28b205ad2fb871894
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4f7c10b4157b2a6e98e8a0e45011c8ba053b4d57
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7b8ebdd7e665c8a3dd153da69763f7d0102e3ba0
Nov 15 06:14:41 user nova-compute[75648]: INFO nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/54d4d3c81643b7564f83b31eaa0ad845531e9027
Nov 15 06:14:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Verification complete {{(pid=75648) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Verify swap images {{(pid=75648) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 15 06:14:41 user nova-compute[75648]: DEBUG nova.virt.libvirt.imagecache [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Verify ephemeral images {{(pid=75648) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 15 06:14:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:14:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:14:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:14:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:15:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:15:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:14 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:16 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Starting heal instance info cache {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Rebuilding the list of instances to heal {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Didn't find any instances for network info cache update. {{(pid=75648) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 15 06:15:18 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager.update_available_resource {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Auditing locally available compute resources for user (node: user) {{(pid=75648) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:20 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:15:20 user nova-compute[75648]: WARNING nova.virt.libvirt.driver [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 15 06:15:20 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Hypervisor/Node resource view: name=user free_ram=9202MB free_disk=25.189529418945312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75648) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 15 06:15:20 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75648) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing inventories for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating ProviderTree inventory for provider 2afde26c-116f-40d4-b607-8ec699f44de3 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Updating inventory in ProviderTree for provider 2afde26c-116f-40d4-b607-8ec699f44de3 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing aggregate associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, aggregates: None {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Refreshing trait associations for resource provider 2afde26c-116f-40d4-b607-8ec699f44de3, traits: COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_ACCELERATORS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SATA {{(pid=75648) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.compute.provider_tree [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed in ProviderTree for provider: 2afde26c-116f-40d4-b607-8ec699f44de3 {{(pid=75648) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.scheduler.client.report [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Inventory has not changed for provider 2afde26c-116f-40d4-b607-8ec699f44de3 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75648) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG nova.compute.resource_tracker [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Compute_service record updated for user:user {{(pid=75648) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 15 06:15:21 user nova-compute[75648]: DEBUG oslo_concurrency.lockutils [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=75648) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 15 06:15:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:23 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:23 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:26 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:26 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75648) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 15 06:15:28 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:33 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:15:33 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_power_states {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:38 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:38 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 15 06:15:38 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] There are 0 instances to clean {{(pid=75648) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 15 06:15:39 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:39 user nova-compute[75648]: DEBUG nova.compute.manager [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Cleaning up deleted instances with incomplete migration  {{(pid=75648) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 15 06:15:43 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:15:43 user nova-compute[75648]: DEBUG oslo_service.periodic_task [None req-8e3a3dc1-a6c0-4f8f-acfe-91a52213bc8d None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75648) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 15 06:15:48 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:52 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:53 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:15:58 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 15 06:16:03 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:16:08 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 15 06:16:13 user nova-compute[75648]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=75648) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}